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(57) Abstract 

The invention describes the preparation and use of fluorescent stains for nucleic acids derived from unsymmetrical cyanine dyes 
comprising a substituted benzazolium ring system linked by a methine bridge to a pyridinium or quinolinium ring system. The cyanine 
dyes of the invention possess a high sensitivity to oligonucleotides and larger nucleic acid polymers in a wide range of cells and gels, and 
are useful for the analysis of cell structure, membrane integrity or function, and determination of cell cycle distribution. 
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SUBSTITUTED UNSYMMETRICAL CYANTNE DYES WITH SELECTED PERMEABILITY 



FIELD OF THE INVENTION 



5 The invention relates to fluorescent dyes fcr ^u^ieic acids. In particular, the invention relates to dyes derived 

from uusyrnmetrical cyanine dyes having defined substituents on the quinolinium or pyridinium ring system, where the 
substituents serve to increase or decrease the permeability, selectivity and binding affinity of the nucleic acid stains. The 
subject dyes, which form a fluorescent complex in combination with nucleic acids, can be used in analyzing a wide 
range of materials, including biological and environmental samples. 

10 

BACKGROUND INFORMATION 



In many fields of life sciences research, including biological, biomedical, genetic, fermentation, aquaculture, 
agricultural, forensic and environmental research, there is a need to identify' nucleic acids, qualitatively and 
15 quantitatively, in pure solutions and in biological samples. Such applications require a fast, sensitive, and selective 
methodology that can detect minute amounts of nucleic acids in a variety of media, whether or not the nucleic acid is 
contained in cells. 



Although certain unsymmetrical cyanine dyes were first described before the genetic role of nucleic acids was 
20 established (Brooker, et al , J. AM. CHEM. SOC. 64, 199 (1942)), some unsymmetrical cyanine dyes are now known as 
effective fluorescent stains of DNA and RNA. The compound sold as Thiazole Orange has particular advantages in 
reticulocyte analysis (U.S. Patent No. 4,883,867 to Lee, et al. (1989)) or in preferentially staining bloodbome parasites 
(U.S. Patent No. 4,937,198 to Lee, et al. (1990)). Thiazole Orange readily stains many mammalian cells, yet does not 
effectively stain some eukaryotic cells. 

25 

Attachment of various cyclic structures to the pyrdiruum or quinolinium ring system of the asymmetrical 
cyanine dye was found to make the nucleic acid stains highly permeant to gels and a wider variety of cell types, including 
both Gram-positive and Gram-negative bacteria, yeasts, and eukaryotic cells as well as prokaryotic cells (U.S. Patent 
No. 5,436,134 to Haugland, et al. (1995), FLUORESCENT ASSAY FOR BACTERIAL GRAM REACTION (Ser. No 
30 08/146,328 to Roth et al. filed 1 1/01/93), FLUORESCENT VIABILITY ASSAY USING CYCLIC ^TBSTITUTED 
UNSYMMETRICAL CYANTNE DYES (Ser. No. 08/148,847 to Millard, et al. filed 1 1/08/93), and U.S. Patent No. 
5,445,946 to Roth et al. (1995)). and International Publication No. WO 94/24213 (Corresponding to PCT application 
94/04127) 

35 Attachment of a cationic side chain at the nitrogen of the pyridinium or quinolinium ring system of the 

unsymmetrical cyanine dyes, on the other hand, was shown to make the stains relatively impermeant to all cells, except 
cells, particularly mammalian cells, where cell membrane integrity was destroyed, as described in UNSYMMETRICAL 
CYANTNE DYES WITH CATIONIC SIDE CHAINS (U.S. Patent no. 5,321,130 to Yue et al. (1994)). A second type 
of dye, in which a dve monomer is attached at the nitrogen of the quinolinium or pyridinium ring system to form dimenc 
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compounds as described in DIMERS OF UNSYMMETRICAL CYANINE DYES (PCT 92/07867) and DIMERS OF 
UNSYMMETRICAL CYANINE DYES CONTAINING PYRIDINIUM MOIETIES (U.S. Patent No. 5,4 10.030 to 
Yue, et al. ( 1 995)) that are also relatively impermeant to all cells unless the cell membrane has been disrupted. 
Although these impermeant dyes were found to have the further advantage of increased binding affinity for nucleic acids, 
resulting in increased sensitivity for detection of cell free nucleic acids, a number of these dyes were also found to have a 
number of disadvantages for some applications, including a slow rate of equilibrium binding, e^ctrostarc attraction to 
glass surfaces, moderate salt sensitivity, reduced photostabikty, lower quantum yield, relatively lower sensitivity of 
detection of nucleic acids in gels and in solutions, and limited permeability to dead prokaryotic cells. 

The dyes of the present invention are unsyrnmetrical cyarune dyes containing a defined substituent on the 
pyridiniurn or quinoliruum ring system or a substituem ,T nmediatelv adjacent to the nitrogen atom of the pyriduiium or 
quinoliruum ring that modifies the permeability, selectivity and affinity of the dye for nucleic acids. Members of this 
class of dyes are more effective in detection of cell membrane integrity and in the staining or detection of nucleic acids, 
including DNA and RNA, in gels and in solutions, and in living and dead cells. Dyes substituted at the position adjacent 
to the ring nitrogen generally have unexpectedly higher quantum yields than dyes not substituted at that position. In 
addition, the ring substituent is easily modified, particularly by inclusion of an appropriate heteroatom in the substituent, 
to allow selectable alteration of the permeability and affiniry of the dyes. Furthermore, by simple synthetic modification, 
a family of dyes having absorption and emission spectral properties that cover most of the visible and near-infrared 
spectrum can be prepared. Selection of an appropriately substituted dye enhances the sensitivity of analysis of nucleic 
acids utilizing a variety of techniques. 



DESCRIPTION OF DRAWINGS 

Figure 1 : The fluorescence excitation and emission spectra for Dye 309 in the presence of ds calf thymus DNA. Note 
the lower intensity absorbances in the UV region of the excitation spectrum, indicating that fluorescence can be 
generated by excitation at those wavelengths, albeit at lower fluorescence yields. 

Figure 2: A multiple labeling experiment using the dyes of the present mvenuon Nucleic acid polymers are generated 
thai are labeled with a detection reagent that is a fluorophore, avidin, strep tavidtn or other hapten (X, Y, and Z) After 
separauon, the resulting bands are visualized and quantitated by staining with a dye of the present invention. The bands 
can be individually identified by treatment with the appropriate reagent, such as biotin, or an antibody (X*, Y*, or Z*) 
This technique is generally described in Example 33. 

Figures 3 A and 3B: Linear fluorescence response as a function of DNA concentration, as described in Example 2 1 
The assay is linear from 25 pg/mL (see inset) to 1000 ng/mL. 

Figure 4: Linear fluorescence response as a runcuon of oligonucleotide concentration, as described in Example 22. The 
assay is linear from an oligonucleotide concentration of 100 pg/mL (see inset) to I ug/mL 
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Figures 5 A and 5B: Linear fluorescence response as a function of cell number, as described in Example 38. Standard 
concentration plots are shown for both NIH/3T3 cells and PX3 cells. 

Figure 6: Fluorescence emission as a function of nucleic acid type, as described in Example 40. 
Figure 7: Fluorescence emission as a function of dye-loading, as described in Example 40. 

Figures 8A, 8B: Analysis of bacterial metabolic activity, as described in Example 45. The cluster of data in Figure 8A 
represents metabolically active bacteria. The signal cluster in Figure 8B represents metabolically quiescent bacteria. 

Figure 9: Analysis of a cell suspension by flow cytometry, as described in Example 47. A linear relationship exists 
between the distribution of cells in the two regions and the actual percentage of live cells in the sample, as shown in the 
inset figure. 

15 Figures 10A, 10B: Analysis of cell cycle distribution using flow cytometry, as described in Example 48. Figure 10A 
shows clusters of signals corresponding to cells in the Gl , S and G2 phases of the cell cycle. Figure 10B depicts a 
histogram showing the distribution of cells among the Gl , S and G2 compartments of the cell cycle. 

M Figure 1 1 A, 1 IB: Analysis of cell proliferation using bromodeoxyuridine labeling followed by bivariate staining, as 

20 described in Example 49. Figure 1 1 A shows clusters of signals corresponding to cells in the GO/G 1 , S and G2 phases of 
the cell cycle. Figure 1 IB depicts a histogram showing the distribution of cells among the G0/G1 , S and G2 
compartments of the cell cycle. 



10 



25 SUMMARY OF THE INVENTION AND DESCRIPTION OF PREFERRED EMBODIMENTS 

The substituted unsyrnmetrical cyanine dyes of the invention are virtually non-fluorescent when diluted in 
aqueous solution. When bound to nucleic acid polymers such as DN A and RNA, however, the resultant dye-nucleic 
acid complex becomes extremely fluorescent upon illuminauon The dyes of the present invention label nucleic acids in 
30 a wide variety of samples, particularly in aqueous soluuons. electrophoretic gels, and a wide variety of cells, including 
microorganisms. 

Dye Structure 

35 The dyes of the invenuon comprise: 1 ) a first heterocyclic nng system that is a substituted benzazolium ring, 

2 1 -ridging methine and 3) a second heterocyclic nng that is a pyridinium or quinolimum ring system, one or more 
po^ -ions of which mav be substituted by a TAIL that contains at least one heteroatom. The first and second ring systems 
are optionally further substituted by a variety of substituents, as described below. 
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TAIL 

TAIL is a heteroatom-contatning side chain, that is described by the formula LINK- SPACER- CAP. LINK is 
the linking moiety by which TAIL is attached to the core structure of the dyes of the present invention. SPACER is a 
5 covalenl linkage that connects LINK to CAP. CAP is the portion of TAIL that possesses a heteroatom component. 

LINK is a single covalenl bond, an ether linkage (-0-), a thioelher linkage (-S-), or an amine linkage (-NR 20 -). 
H In each embodiment, LINK forms the attachment between the dye core snucmre and SPACER. When LINK is an 

% amine, the amine substituent (R 20 ) is optionally H, such that LINK = -NH-. Alternatively, R 20 is a linear or branched 

10 alkyl having 1 -8 carbons In another embodiment of the invention, R 20 is -SPACER -CAP', yielding a T/^JL having the 
formula 

SPACER— CAP 

* — n' 

""SPACER -CAP* 

where SPACER 1 and CAP', respectively, may be the same as or different from SPACER and CAP, and are selected from 
1 5 the same alternatives defined for SPACER and CAP, respectively. For the sake of simplifying the description, 
3| SPACER and CAP are defined with the understanding that a description of SPACER includes SPACER', and a 

^ description of CAP includes CAP' 

SPACER is a covalent linkage that joins LINK and CAP SPACER is a linear, branched, cyclic, heterocyclic, 
20 saturated or unsaturated arrangement of 1 - 1 6 C, N, P, O or S atoms. Alternatively, SPACER is a single covalent bond, 
such that both LINK and SPACER are not simultaneously single covalent bonds. Preferably, the SPACER linkage must 
begin and end with a carbon atom. Typically, if SPACER consists of a single atom, it is required to be a carbon atom, so 
that the first and last 2tom in SPACER (in this specific instance, they are the same atom) is a carbon. The 1-16 atoms 
making up SPACER are combined using any appropriate combination of ether, thioether, amine, ester, or amide bonds; 
25 or single, double, tnple or aromatic carbon-carbon bonds; or phosphorus-oxygen bonds; or phosphorus-sulfur bonds; or 
nitrogen-nitrogen bonds; or nitrogen-oxygen bonds; or aromauc or heteroaromauc bonds. SPACER is further 
substituted by hydrogen to accommodate the valence state of each atom in SPACER. 

^ Generally, the atoms of SPACER arc arranged such that all heteroatoms in the linear backbone of SPACER are 

30 separated by at least one carbon atom, and preferably separated by at least two carbon atoms. Typically, SPACER is 1 - 
6 carbon atoms in a linear or branched saturated chain. In one embodiment of the invention, SPACER incorporates a 6- 

i 

membered aromatic ring (phenylene linkage) In another embodiment of the invention, SPACER incorporates a 5- or 6- 
membered heteroaromauc nng, wherein the heteroatoms are O, N, or S. Alternatively, SPACER incorporates amide 
linkages, ester linkages, simple ethers and thioethers, and amines in a linear arrangement, such as -CH 2 -CH 2 -(C=0)- 
35 NH-CH r CH r CH r . Preferably, SPACER is a linear chain composed of sequential methylene groups (-(CH 2 ) k -, where 
k = 1-8) 
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LINK and SPACER, in combination, serve to attach a heteroatom-containing group, CAP, to the dye core 
structure. CAP may contain oxygen, sulfur or nitrogen, according to the formulas -O-R 21 , -S-R* 1 , -NR 2, R* 2 , or 
-r>TR 2I R 22 R 23 T". The substituents R 21 , R 22 , and R 23 are independently H, or a linear or branched alkyl or cycloalkyl 
having 1 -8 carbons. Where any of R 21 , R 22 and R 23 are alkyl or cycioalkyl, they are optionally further substituted by 
halogen, hydroxy, alkoxy having 1 -8 carbons, amino, carboxy, or phenyl, where phenyl is optionally further substituted 
by halogen, hydroxy, alkoxv having 1 -8 carbons, amino, airunoalkyl having I -8 carbons, or carboxyalkyl having 1 -8 
carbons. Ln another embodiment of the invention, one or more of R 21 , R 22 and R 23 , taken in combination with SPACER 
forms a 5- or 6-membered ring that is aromatic, heteroaromatb, alicyclic or heteroaiicyclic ring. When the 5- or 6- 
membered ring is heteroaromatic or heteroaiicyclic, the ring contains 1 -3 heteroatoms that are 0, N or S. Alternatively, 
one or more of R 2i . R 22 , and R 2 \ taken in combination with R 20 and SPACER, forms a 5- or 6-membered ring that is 
aromatic, heteroaromatic, alicyclic or heteroalicvchc nng, as descnbed above. Preferably, R 21 , R 22 are hydrogen, or 
alkyls having 1 -8 carbons. R 23 is typically H or alkyl having 1 -8 carbons. When CAP is -N~R 21 R 22 R 23 Y, the 
substituents R 21 , R 22 and R 23 are typically not hydrogen, so that the positive charge present on the ammonium nitrogen 
is not subject to equilibrium neutralization in aqueous solutions. 

When CAP is -bTR 21 R 22 R 23 T*, the biologically compatible counterion T balances the positive charge 
present on the CAP nitrogen, which is a quaternary ammonium salt As used herein, a substance that is biologically 
compatible is not toxic as used, and does not have a substantially deleterious effect on biomolecules. Examples of T' 
include, among others, chloride, bromide, iodide, sulfate, alkanesulfonate, arylsulfonate, phosphate, perchlorate, 
tetrafluoroborate, tetraarylboride, nitrate and anions of aromatic or aliphatic carboxyhc acids. Preferred T* counterions 
are chloride, iodide, perchlorate and various sulfonates. 



Additionally, there are several embodiments of the present invention wherein CAP incorporates a cyclic 
structure. In these embodiments, CAP typically incorporates a 4- to 10-membered ring, preferably a 5- or 6-membered 
25 ring, that contains at least one nitrogen atom. The nitrogen atom incorporated within the cyclic structure is optionally 

substituted by R 23 to give an ammonium salt. Where CAP incorporates a cyclic structure, the cyclic structure optionally 
including an additional heteroatom (typically oxygen or sulfur). Specific versions of CAP include, but are not limited to, 
those listed in Table 1 



30 



Table 1. Examples of specific CAP moieties 
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CAP is preferably -NR 21 R 22 or -r^R^R^R 23 W\ where R 21 , R 22 , and R 23 arc alkyls having 1-6 carbons. 
More preferably CAP is -N(CH 3 ) 2 or -NT(CH : ) 3 

Preferably TAIL contains 6-10 non-hydrogen atoms, including LINK and CAP 

Selected examples of TAIL are listed in Table 2. For each TAIL, the identities of LINK, SPACER and CAP 
are specified. Where R 21 , R 22 , or R 23 combined with either R 20 or SPACER, the combination is indicated in the table 
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SUBSTITUTE SHEET (RULE 26) 
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Core Structure 



The core structure of the dyes of the present invention are described by the formula; 



6 



(R 1 ) ( — ^JJ^ x / > ~ (CH-CH)«CH=^ m ^ R € 



P V R 7 



where the substituted benzazohum ring system on the left is linked by a methine bndge to the right-hand pyridiniurn or 
quinolinium ring system. One or more substituents on the core structure ts optionally a TAIL. 



Although R 1 on the benzazolium ^ z system is usually H, incorporation of one or more non-hydrogen 
substituents R 1 can be used to fine tune the absorption and emission spectrum of the resulting dye. The benzazole may 
contain more than one subsuruent R 1 , which may be the same or different (t =1-4). Each R l is optionally an alkyl group 
having from 1 -6 carbons; or a trifluoromethyl; or a halogen; or an alkoxy having 1 -6 carbons. Typically, each 
1 5 compound contains no more than one R 1 that is not H. Preferably, R 1 is H or alkoxy, more preferably each R 1 is H 

The substituent R 2 is an alkyl group having 1 -6 carbons, preferably methyl or ethyl, more preferably methyl. 

The counterion Y' is a biologically compatible ion, as described above. Preferred ¥' countenons are chloride, 
20 iodide, perchlorate and various sulfonates. 

X is one of O, S, Se or NR 15 , where R 1 5 is an alkyl group having 1 -6 carbons. Alternatively, X is CR I6 R 17 , 
where R 16 and R 17 , which may be the same or different, are independently H or alkyl groups having 1 -6 carbons, or the 
carbons of R 16 and R 17 taken in combination complete a five or six membered saturated ring. When X is CR I6 R 17 , R 16 
25 and R 17 are typically methyls. Preferably, X is O or S. more preferably X is S 

The two heterocyclic nng systems are linked by 1 , 3 or 5 methine (-CH=) groups in such a way as to permit 
extensive electronic delocalizauon The number of methine groups between the heteroaromatic nngs influences the 
spectral properties of the dye. Preferably n = 0 or 1 , more preferably n = 0 



The N-bound substituent R 5 is an alkyl, alkenyl, polyalkenyl, alkynyl or polyaikynyl group having 1-6 carbons. 
Alternatively, R 5 is a cyclic substituent or a TAIL. Typically R 5 is an alkyl having 1 -6 carbons, preferably 1 -2 carbons, 
or R 5 is a cyclic substituent. Alternatively, R 5 is a TAIL Typically, when R 5 is a TAIL, the SPACER moiety 
incorporates a phenylene linkage 



10 
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When R 5 is a cyclic substituent, ihe cyclic substituent is a saturated or unsaturated, substituted or unsubstituted 
ring system with 2-16 ring carbon atoms in I -2 alicyclic. heteroalicyclic, aromatic, or heteroaromatic rings containing 1 - 
4 heteroatoms (wherein the hetero atoms are O, N or S) that is directly bonded to the pyridinium or quinolinium ring 
\ system by a single bond. Alicyclic ring systems are either linked or fused. Typically R 5 is an aryl, a heteroaryl, or a 

5 cycloaikyl having 3-10 carbens, more typically an aryl or heteroaryl group Typically the aryl is a phenyl or naphthyl 
'4 group, and the heteroaryl substituent is a 5- or 6-membered heteroaromatic nng, wherein the heteroa;Dm is O, N or S. 

Examples of alicyclic and hctroalicyclic subsututents are substituted or unsubstituted cyclohexyls, cyclohexenyls, 

S morpholinos, piperidinyls and piperazinyls. Examples cf aromatic and heteroaromatic cyclic substituents include 

H 

$ substituted or unsubstituted naphthyls, phenyls, thienyls, benzothiazolyls, furanyls, oxazolyls, benzoxazolyls, and 

10 pyridinyls. Substituents on such cyclic substitutems are independently hydrogen, halogen, alkyt, perfluoroalkyl, amino, 
alkylamino, dialkylamino, alkoxy or carboxyalkyl, each alky! group having t -6 carbons. Preferred cyclic subsituents are 
substituted or unsubstituted naphthyl, phenyl, thienyl, morpholino, and cycloaikyl having 3-10 carbons, more preferably 

\i substituted or unsubstituted phenyl. 

1 5 The second nng system contains a ring fragment Y that is -CR 3 =CR 4 -, with subscripts p and m equal to 0 or 1 , 

such that p + m - 1 . For all embodiments, the ring contains a 6 membered pyridinium-based heterocvele according to 
one of these formulations 



k R 2 R 5 ^ R 6 

(R 1 ),-^j]^ ^_(CH=CH)-CH=<^^>— R 

R 3 ^V 



or 




R 2 R 3 , R 4 



( R 1 )_{r ^ (C H=CH)-CH==/^jN-R 5 



R 7 ' V 



In preferred embodiments of the invention, m = l and p = 0 ("^pyndiniums" and "4-quinoliniums"). 



The nng subsutuents R 3 and R 4 are independently H, or a halogen, or an alkyl, alkenyl, polyalkenyl, alkynyl or 
25 p^lvalkynyl group having 1-6 carbons. R 3 and R 4 are also optionally and independently -OR 8 , -SR 8 , -(NR 8 R 9 ), where 
R 8 and R 9 , which can be the same or different, are independently H, alkyl groups having 1 -6 carbons, 1 -2 alicyclic or 
aromatic rings, or R 8 and R 9 taken in combination are -(CH 2 ) 4 - or -(CH 2 ) 5 - to give a 5- or 6-membered nng. 
Additionally, R 3 and R 4 are optionally and independently -OSO : R 19 where R 19 is alkyl having 1 -6 carbons, or 
perfluoroalkyl having 1 -6 carbons, or aryl 
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The ring subsutuents R 6 and R 7 are optionally any subsutuent defined for R 3 and R 4 , with the exception of 
-OS0 2 R 19 Alternatively, R 6 and R 7 taken in combination are -(CH 2 ) V - where v = 3 or 4, forming a fused 5- or 6- 
membered ring, or R 6 and R 7 , taken in combination form a fused 6-membered aromauc ring. 

Alternatively, any of R 3 , R 4 , R 6 or R 7 coi*' J K e a cyclic subsutuent, as defined earlier for R 5 . Preferred ring 
substituents are independently H, aikyl, halogen, -OR 8 , -SR 8 , -(NR 8 R 9 ), -OS0 2 R 19 , a cyclic svbstinient, or a TAIL. 
For all embodiments of the present invention, preferably R 4 is not hydrogen. In one embodiment of the invenuon R 4 is 
halogen, -OR 8 , -SR 8 , -(NR 8 R 9 ), or -OS0 2 R 19 In another embodiment of the invention R 4 is an aikyl having 1-6 
carbons. In yet another embodiment of the invenuon, R 4 is a TAIL. 

Where R 6 and R 7 taken in combination form a fused 6-membered aromatic ring, embodiments of this invenuon 
are quinoliruum derivatives according to the formula 



where ring substituents R U ,R 12 ,R 13 , andR 14 may be the same or different, and are independently H; or an aikyl. 
aikenyl, polyalkenyl, alkynyl or polyalkynyl group having 1 -6 carbons; or a halogen; or -OR 8 , -SR 8 , -(NR 8 R 9 ), where R s 
and R 9 are as defined previously; or a cyclic subsutuent, as defined for R 5 , or a TAIL. Preferred embodiment of the 
invenuon are quinoliniums wherein m = 1 and p = 0 ("4-qumolimums"). 

Typically, one or more of R 3 , R 4 , R 5 , R 6 . R 7 , R 1 1 , R 12 , R 13 and R u is a TAIL. In one embodiment of the 
invenuon, at least one of R 3 , R 4 , R 5 , R 6 , R 7 , R n , R 12 , R 13 and R 14 is required to be a TAIL. Preferably,at least one of 
R 4 , R 6 , or R 12 is TAIL, more preferably, R 4 is a TAIL. When R 4 is a TAIL, LINK is preferably -NR 20 - or -S- When 
TAIL is at any posiuon other than R 4 or R 5 , LINK is preferably -O- or a single bond. 

In one embodiment of the invenuon. R 5 is a TAIL, and one of R 3 , R 4 , R 6 , R 7 , R n , R 12 , R 13 or R 14 is not 
hydrogen, preferably R 4 is not hydrogen. 

In another embodiment of the invention, R 5 is not a cyclic subsutuent, and R 4 is not hydrogen. Compounds 
wherein R 4 is not hydrogen possess significant advantages for staining nucleic acids. In particular, dyes where R 4 is not 
hydrogen possess enhanced quantum yields relative to similar dyes wherein R 4 is H. For this class of dyes, R 5 is 
preferably aikyl having 1 -6 carbons. R 4 is typically -OR 8 , -SR 8 , -(NR 8 R 9 ), or R 4 is a TAIL, preferably R 4 is a TAIL 
In a specific embodiment of the invenuon. the dyes of the invention are 4-pyridiruums or 4-quinoliniums, wherein R 3 is 
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an alkyl having 1 -6 carbons, and R 4 is not hydrogen. 

In yet another embodiment of the invention, R 5 is a cyclic substituent, and at least one of R 3 , R\ R 6 , R 7 , R 1 1 , 
R 12 , R 13 or R u is a TAIL having a CAP that is -lsTR^R^R 23 Y\ or a CAP that incorporates incorporates a 4- to 10- 
5 membered ring, preferably a 5- or 6-membered ring, that contains at least one nitrogen atom. 

In an additional preferred embodiment of the invention, the second heterocyclic ring contains exactly two non- 
hydrogen substituents, one of which is a TAIL. 

10 Some of the dyes of the present invention that possess a TAIL moiety at R 4 exhibit particular utility for staining 

cells and rnicro^arusms. The utility of specific embodiments of the dyes of the present invention in staining cells and 
microor ganisms is generally dependent on the chemical nature of the TAIL moiety, and the identity of the group present 
at R 5 . For example, those compounds for which CAP is a quaternary ammonium salt are generally impermeant to living 
cells, with the exception of some yeast cells. However, the permeability of those compounds for which CAP is a 

1 5 primary or secondary amine, and LINK is a secondary or tertiary amine, are related to the nature of R 5 (the N- 

substituent): Where R 5 is an aryl group, the compounds are generally permeant to all cells, living or dead, but the 
corresponding compounds having an alkyl substituent at R 5 are generally impermeant to cellular membranes. A similar 
relationship to the R 5 substituent is observed where TAIL is a nitrogen-containing heterocycle: Where R 5 is an aryl 
group, the compounds are generally permeant to all cells, but when R 5 is an alkyl group, the dyes are generally permeant 

20 only to mammalian cells. 

Typically, dyes useful as impermeant cellular probes are those dyes having 2-3 positive charges, preferably 3 
positive charges, more preferably having 2-3 positive charges where R 5 = alkyl. Preferred dyes for permeant cellular 
probes are dyes wherein R 5 is alkyl having 1 -6 carbons, aryl or heteroaryl and CAP is -O-R 21 or -S-R 21 . Dyes that are 
25 preferred for staining electrophoretic gels typically have CAP that is a dialkylammo group. 

A list of selected emodiments of the present invention is presented in Tables 3, 4 and 5. While the table 
includes many preferred embodiments, the dyes shown in the Tables are not intended to be an exclusive list of the dyes 
of the present invention. Numerous modifications, substi anions, and alterations in substituents and dye structure are 
30 possible without departing from the spirit and scope of the invention. 
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Table 3: Specific examples of 4-qumolinjum dyes 
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Table 4: Specific examples of 4-pyridinium dyes 



PCT/US95/13706 





R 6 




Dye 


X 


n 


R 4 


R 5 


R 6 


I 


322 


0 


0 




phenyl 


H 


5 


1182 


s 


0 


-CH 3 


-CH 3 


-CH 3 


~\ 


3100 


s 


0 


-CH 3 


-CH 3 


H 



■4. 



4 



Table 5: Specific examples of 2-quinolimum dyes 
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Synthesis 

A useful synthetic route to the dyes of the present invention can be described in inree parts, following the 
! natural breakdown in the description of the compounds. In general, the synthesis of these dyes requires three precursors: 

5 a benzazolium salt, a pyridinium (or quinolinium) salt (both of which have the appropriate chemical subs'ituents, or can 
be converted to the appropriate substituents), ar.d (wher? n = i or 2) a source for the methire spacer. The combination 
that enables these compounds to be useful stains for nucleic acids has not been described previously, but the chemistry 
| that ,s ieqUire d to prepare and combine these precursors so „ to yield any of the subject denvauves ,s genexaHv well- 

$ understood by one skilled in the art. Although there are many possible variations that may yield an equivalent result, we 

10 provide herein some useful general methods for their synthesis and incorporation of chemical modifications, 

i 

The pvndinium or quinohnium moiety 

• The strongly conjugated ring system of the compounds of the present invention allows resonance stabilization 

15 of the single positive charge on the ring atoms to be distributed over the entire molecule, in particular, the charge is 
stabilized by partial localization on each of the heterocyclic nitrogen atoms of the dye. As the subject dye is drawn 
herein, the positive charge is formally localized on the benzazolium portion of the dye. However, it is commonly 
|j understood that a comparable resonance structure can be drawn in which the positive charge is formally localized on the 

pyridinium portion of the dye. Consequently, we will usually refer to this latter portion of the molecule as a pyridine, 
20 pyridinium, quinoline or quinolinium moiety, although in the resonance structure shown, it would formally be termed a 
dihydropyridine or dihydroquinoline. 

Compounds containing the quinolinium moiety in this invention differ from those that contain a single 
pyridinium ring only in the presence of an additional aromauc ring containing four carbon atoms that is fused at the R 6 
25 and R 7 positions of the parent structure. Except where reference is to a specific pyridine or pyridinium sa* M it is 

understood that mention of pyridines or pyridinium salts encompasses benzopyndines and benzopyridinium salts, which 
are formally called quinolines or quinolinium salts. Mention of quinohnes and quinolinium salts refer only to structures 
containing two fused aromatic rings. 

30 In the synthesis of the dyes of the invention, the second heterocyclic precursor is usually a pyridinium salt that 

is already appropriately subsututed (as in Examples 2, 9, and 1 1 ) Alternatively, substituents can be incorporated into 
the pyridinium structure subsequent to attachment of the benzazolium portion of the dye (Example 5). One of the 
'J subsutuents, which may be incorporated before or after reaction with the benzazolium precursor is TALL. 

35 Aside from the structural differences between pyridines and quinolines, there exist two major structural 

distinctions within the family of dyes desenbed in the invention, related to the point of attachment of the pyridinium 
moiety. In one case (where m = 0 and p - 1 ) the position of attachment places the methane bridge adjacent to the ring 
nitrogen (2-pyndines). In the more common case (where m = 1 and p = 0) the position of the nitrogen atom is para to 
the point of attachment (4-pyridines) 
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Typically the required pyridinium salt precursor has the structure 
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with the substitucnts as defined previously. At all times, the ring is a 6-membered pyridmium- based heterocycle. 

When n = 0, B is methyl, or B is chloro, bromo or iodo. When n = 1 or 2, B is methyl. Only when n = 1 or n = 
2 is any pan of B incorporated in the final compound. 

There are several general methods for the synthesis of derivatives of pyridinium, including those derivatives 
having substituents at any available position, including substitutions that are TAIL or that can be converted to TAIL 
before or after reaction with the benzazolium portion to form the dye core structure. Substitutions at R 5 or at the 
position immediately adjacent to the nitrogen atom to which R 5 is attached (i.e. at R 4 when m = 1 and p = 0) are 
particularly important. 

Method 1 . Alkylauon of the nitrogen atom of an appropriately substituted quinoline with an alkylating agent such as a 
primary aliphauc halide sulfate ester, sulfonate ester epoxide or similar reagent directly yields a substituted quinolinium 
salt. For example, treatment of a quinoline with 1 ,3-diiodopropane and base, followed by heating with trimemylamine, 
yields a TAIL substituent at R 5 (Example 1 8). If there is a TAIL substituent, or a group that can be converted to a 
TAIL substituent, at a position other than R 5 , then simple alkylating agents such as methyl iodide or dimethyl sulfate 
suffice to add the R 5 substituent, where R 5 is alkyl. 

Method 2 R 5 subsutuents that are arvi or heteroaryl are best incorporated by an Ullmann reaction of aniline or a 
substituted aniline or of a pyridone or quinolone derivative. In this method, a diaryl amine or aryl-heteroaryl amine 
(generally commercially available) is condensed with diketene and acid to yield a 4-methyl-N-arylquinolone or a 4- 
methyl -N-heteroarylqumolone (as in Example 1) 
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In the above formula, ARYL can be any aromatic or heteroaromatic nng system. Farther, R n , R 12 , R 13 , R 1 ', 
and substituents on ARYL may be a TAIL, or may be substituents that can te readily converted to a TAIL (Example 
10). 

The 4-ri:£thy!-2-quinolone is then converted to the desired 4-melhyl-2-substituted-quinolinjum salt by reaction 
with an organometalhc reagent such as a Grignard or organolithium reagent (Examples 9 and 10) 




An R 4 substituent attached in this way may be aromatic or aliphatic and can be a TAIL or can be converted to 
TAIL (as in Example 13), provided that the nature of the substituent does not interfere with preparation of the required 
organometalhc reagent. 

Pyridone and quinolone precursors may also be prepared by an Ullmann reaction of the appropriately 
substituted precursor if the nitrogen atom is hydrogen-substituted such as by the following reactions: 
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ARYl-X / Cu 





AHYL-X/Cu 
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H 3 C (' \— ARYL 




While a variety of 4-methyl-2-quinoloncs are commercially available, desired derivatives can be synthesized by 
reaction of aniline or a substituted- aniline with an acetoacetate or acetoacetate equivalent reagent such as diketene 




diketene 




10 



15 



Pyridone and quinolone intermediates containing a non-hydrogen group at R 5 are panicularly important 
precursors to a wide variety of other pyridinium and quinoliruum salts that are substituted at R 4 . In particular, a salt is 
formed by treatment of the appropriate pyridone or quinolone with a strong chlorinating agent such as PC1 5 , POCI 3 or 
SOCl 2 , for instance in the reaction below (Example 2). Similarly, a sulfonate can be substituted at R 4 by treating the 
pyridone or quinolone with the appropriate sulfonic acid anhydride 
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Halogen displacement 

5 

The reactivity of the 2-halogenated pyridinium or quinolinium intermediate offers a variety of synthetic 
methods for attachment of various substituents at the 2 -position, including TAJLs and TAIL precursors However, the 
reactivity of the 2-halo derivatives is preserved even after conjugation with the benzazolium precursor, enabling 
conversion of the resulting dye in which R 4 is halogen into the appropriate alkoxy, amino and thiolate analogs, as 
10 described for the pyridinium and quinolinium precursors. Of particular utility for the dyes of the present invention is the 
displacement of a 2-chloro substituent by amines (yielding TAIL or TAIL precursors where LINK is -NR 20 -), thiols 
(yielding TAIL or TAIL precursors where LINK is -S-) or alcohols (yielding TAIL or TAIL precursors where LINK is • 
0-). The displacement of chlonde by amines is described in Example 5, and the displacement of chloride by thiols is 
described in Example 7 

15 

Additionally, the 2-oxo group of pyndone or quinolone precursors can be chemically reduced to derivatives in 
which R 4 is H using a variety of reagents including DH3AL-H (diisobutylaluminum hydride). 



TAIL 

** 20 

As described earlier, TAIL is composed of three pans LINK, SPACER and CAP If a TAIL is present as R 5 . 
then LINK is constrained to be a single bond, eliminating the potential of N-S. N-0 or N-N bonds in TAIL. The 
chemical composition of SPACER is determined by the chemistry required to attach the heteroatom in CAP with the dye 
core structure via LINK 

25 

As described above, those dyes of the present invention that are 4-pyndiniums or 4-quinoliniums wherein R 4 is 
a TAIL are most conveniently synthesized from the 2-halopyridinium or 2-haloquinolinium precursor either before or 
fcS after condensation with the benzazolium portion of the dye by a nucleophihc displacement reaction of the halogen by a 

thiol, alkoxide, or a primary or secondary amine 
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CAP may be incorporated directly into TAIL before or after condensation of the pyridinium or quinoluuum sail 
with the benzazohum salt, or CAP may be added or further modified at a later stage in the synthesis. For instance, when 
CAP is a cyclic or non-cyclic primary, secondary or tertiary amine, CAP can be alkylated to a quaternary ammonium 
(Examples 6, 7 and 8). This reaction can be used to increase the polarity of the dye and to thus restrict its penetration 
5 through the membrane of living cells, and to additionally increase the dye's affinity for nucleic acids. 

Precursors to TAIL include carboxyiic acids, halides, alcohols and thiols. Each of these reactive groups can be 
used to attach a heteroatom containing moiety (i.e., CAP) to the dye core s'rucuire, generally through the formation of 
amides (Example 1 5 and 16), ethers or thioethers, which are incorporated into SPACER before (Example 1 5) or after 
10 (Example 16) attachment of SPACER to the dye core structure. 

Condensation of the dve 

The benzazohum precursors are prepared and condensed with the pyridinium or quinolinium salts according to 
15 the synthetic procedures outlined in U S Patent No 5,436,134 to Hauglandet al. (1995). The specific method of 
conjugation and reagents used result in a methine, mmethine or pentamethine bridge between the two ring systems 
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The use of the invention comprises combining a dye of the present invention with a sample that contains or is 
thought to contain a nucleic acid polymer, incubating the mixture of dye and sample for a time sufficient for the dye to 
5 combine with nucleic acid polymers in the sample to form one or more dye-nucleic acid complexes having a detectable 
H fluorescent signal. The characteristics of the dye-nucleic acid complex, including the presence, location, intensity, 

excitauon and emission spectra, fluorescence polarization, fluorescence lifetime, and other physical properties of the 
|j fluorescent S'gnal can be used tc detect, differentiate, sort, quantitate, and/or analyze aspects or portions of the sample. 

% The dyes of the invention are optionally used in conjunction with one or more additional reagents (preferably detectably 

10 different fluorescent reagents), including dyes of the same class having different spectral properties. 

% 

Staining Solution 

Typically, the subject dye is prepared for use by dissolving the dye in a staining solution, preferably an aqueous 
1 5 or aqueous-miscible solution that is compatible with the sample and the intended use. For biological samples, where 

minimal perturbation of cell morphology or physiology is desired, the staining solution is selected accordingly. The dye 
is typically dissolved directly in an aqueous solvent such as water or a buffer solution, such as buffered saline, or is 
*S dissolved in a water-miscible organic solvent such as dimethylsulfoxide (DMSO), dimelhylformamide (DMF), or a 

^ lower alcohol such as methanol or ethanol, at a concentration of greater than about 100-times that used in the staining 

20 solution, then diluted one or more limes with an aqueous solvent such as water or buffer, such that the dye is present in 
an effective amount. 

An effective amount of dye is the amount sufficient to give a detectable fluorescence response in combination 
with nucleic acids. The dye concentration in the solution must be sufficient both to contact the nucleic acids in the 
25 sample and to combine with :he nucleic acids in an amount sufficient to give a signal, while minimizing background 
fluorescence. Typically staining solutions for cellular samples have a dye concentration greater than 0. 1 nM and less 
than 50 |iM, more typically greater than 1 nM and less than 10 uM, preferably between 0.5 and 5 uM. In general, lower 
concentrauons of dyes are required for eukaryotes than for prokaryotes, and for dyes with higher sensitivity Staining 
soluuons for electrophorehc gels typically have a dye concentration of greater than 0. 1 uM and less than 10 uM, more 
30 typically about 0.5-2 uM. the same holds true where the dye is added to the gel (pre-cast) before being combined with 
nucleic acids. Staining solutions for detection and quantitauon of free nucleic acids in solution typically have a 
concentration of 0. 1 uM-2 jxM The optimal concentration and composition of the staining soluuon is determined by the 
"k nature of the sample (including physical, biological, biochemical and physiological properties), the nature of the dye- 

sample interaction (including the transport rate of the dye to the site of the nucleic acids), and the nature of the analysis 
35 being performed, and can be determined according to standard procedures such as those described in examples below 

Sample Types 

^ The dye is combined with a sample that contains or is thought to contain a nucleic acid. The presence of the 
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nucleic acid in the sample may be due to natural biological processes, or the result of a successful or unsuccessful 
synthesis or experimental methodology, undesirable contamination, or a disease state. The nucleic acid may be 
endogenous or introduced as foreign material, such as by infection, transfection, or therapeutic treatment. 

5 The mxleic acid in the sample is RNA or DNA, or a mixture or a hybrid thereof Any DNA is opuonally 

^ single-, double-, triple-, or quadmple- stranded DNA; .my RNA is opuonally single stranded ("ss") or double stranded 

faV). The nucbic acid may be a natural polymer (biological in origin) or a synthetic polymer (modified or prepared 
j$ artificially). The nucleic acid poly me 1 ' (preferably containing at least 8 bases or base pairs) may be present as nucleic 

Jg acid fragments, oligonucleotides, or larger nucleic acid polymers with secondary or tertiary structure. The nucleic acid 

10 is opuonally present in a condensed phase, such as a chromosome (Examples 26, 27) The nucleic acid polymer 

opuonallv contains one or more modified bases or links or contains labels that are non-covalentJv or covalentlv attached 
y " For example, the modified base can be a naturally occurring modified base such as \\i (pseudouridine) in tRNA, 5- 

_j methylcytosme, 6-memylaminopunne, 6-dunethylaminopurine, 1 -methyl guanine, 2-meuhylarnino-6-hydroxypunne, 2- 

oUmcmylamino-6-hydroxypurine, or other known minor bases (see, e.g. Davidson, THE BIOCHEMISTRY OF THE 
1 5 NUCLEIC ACIDS ( 1 976)) or is synthetically altered to contain an unusual linker such as morpholine derivatized 

phosphates (Anti Virals, Inc., Corvallis, OR), or peptide nucleic acids such as N-(2-aminoethyl)glycine units (Wittung, 
et al.. Nature 368, 561 (1994)) or contain a simple reactive functional group (<10 carbons) that is an aliphatic amine, 
jj| carboxylic acid, alcohol, thiol or hydrazine, or contain a fluorescent label or other hapten, where the label is originally 

^ attached on the nucleotide or on the 3* or 5' end of the polymer, or ligands non-covalently attached to the nucleic acids 

20 (e.g. Examples 28, 29). Typical modified bases include inosine, bromodeoxyuridine and iododeoxyuridine, and bases 
labeled with haptens such as biotin, digoxigerun, or 2,4-dinitrophenyl, or with fluorophores. The presence of such 
labels does not significantly interfere with DNA amplification or with subsequent analysis on gels or in soluuon 
(Example 33; Figure 2). 

25 The sample that contains the nucleic acid is opuonally a biological structure (i.e. an organism or a discrete unit 

of an organism), or a soluuon (including solutions mat contain biological structures), or a solid or semi-solid material. 
Consequently, the nucleic acid used to practice the invenuon is optionally free in soluuon, immobilized in or on a solid 
or semi -solid material, extracted from a biological structure (e.g. from lysed cells, tissues, organisms or organelles), or 
remains enclosed within a biological structure. The biological structure mat encloses the nucleic acid is optionally a cell 
30 or tissue, for example where the nucleic acid is present in a cell or intersutial space as a prokaryote or eukaryote 

microorganism, or as a virus, viroid, chromosome or organelle. Alternatively, the biological structure is not enclosed in 
a ussue or cell, and is present either as a virus or as a microorganism or other cell, or is present as a cellular component 

# removed from its parent cell (e.g. a plasmid or chromosome, or a mitochondrion or nucleus or other organelle). 

35 Typically, the sample is a cell or is an aqueous or aqueous miscible solution that is obtained directly from a 

liquid source or as a wash from a solid material (organic or inorganic) or a growth medium in which cells have been 
introduced for cultunng or a buffer solution in which nucleic acids or biological structures have been placed for 
evaluation. Alternatively, the sample is a solid, optionally a smear or scrape or a retentate removed from a liquid or 

* vapor by filtrauon. In one aspect of the invention, the sample is obtained from a biological fluid, such as urine, 
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cerebrospinal fluid, blood, lymph fluids, tissue homogenate, interstitial fluid, cell extracts, mucus, saliva, sputum, stool, 
physiological secretions or other similar fluids. Alternatively, the sample is obtained from an environmental source such 
as soil, water, or air; or from an industrial source such as taken from a waste stream, a water source, a supply line, or a 
' production lot. Industrial sources also include fermentation media, such as from a biological reactor or food 

5 fermentation process such as brewing; or foodstuffs , such as meat, grain, produce, or dairy products (Example 42). 

i 

The sample solution can vary from one of purified or synthetic nucleic acids such as oligonucleotides to crude 
% mixtures s ach as cell extracts or homogenates or other biological fluids, or dilute solutions from biological, industrial, oi 

|i environmental sources. In some cases it is desirable to separate the nucleic acids from a mixture of biomolecules or 

( 10 fluids in the solution prior to combination with the dye. Numerous techniques exist for separation and purification of 

nucleic acids, including such means as chromatographic techniques and electrophoretic techniques, using a variety of 
supports or solutions or in a flowing stream, or using nuclease degradation. 



Cell types for which the dye is an effective nucleic acid stain include cells with or without nuclei, including but 
1 5 not limited to, eukaryotes, such as plant and animal cells (particularly vertebrate cells), including pollen and gamete 

cells; prokaryotes, particularly bacteria, including both Gram-negative and Gram-positive bacteria; as well as yeast and 
other fungi, and spores. The cells are optionally single cells, including microorganisms, or multiple cells associated with 
|j other cells in two or three dimensional layers, including multicellular organisms, embryos, tissues, biopsies, filaments, 

H biofilms, etc. The cells are viable or dead cells or a mixture thereof Alternatively, the cells are blebbing or undergoing 

20 apoptosis or in a cycle of growth or cell division. The dyes are not equally effective in staining all cell types and certain 
dyes are generally more permeant than others. Live cells are less permeable to the dyes than dead cells, and prokaryotes 
' are less permeable than eukaryotes (see Table 6). Some of the dyes are generally not permeant to live cells with intact 

membranes, other dyes are generally permeant to eukaryotes but not to prokaryotes; still other dyes are only permeant to 
cells in which the cell membrane integrity has been disrupted (e.g. some dead cells). The relative permeability of the 
25 cell membrane to the dyes is determined empirically, e.g. by comparison with staining profiles or staining patterns of 
killed cells. The dye with the desired degree of permeability, and a high absorbance and quantum yield when bound to 
nucleic acids, is selected to be combined with the sample. 

Furthermore, the differential permeability of bacterial and higher eukaryotic dells to some dyes allows selective 
30 staining of live mammalian cells with little or no staining of live bacteria. A dye selected to be permeant to bacteria can 
be used in combination with a dye that is only permeant to eukaryotes to differentiate bacteria in the presence of 
eukaryotes. Dead bacteria with compromised membranes, such as those in the phagovacuoles of acuve macrophages or 
fj neutrophils, may be rendered permeable to the dyes that are otherwise only permeant to eukaryotes, as a result of toxic 

agents produced by the phagocytic cells (Example 44). 
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Dye 


Baciena 


Yeast 


Eukoryotes 


Live 


Dead 


Fixed/ 
Permeabilized 


Live 


lf\\\*A 

isjuea 




ivuiocn 


Bkg 


INUCJ 




Nuc 
1 




INUCJ 




298 


2 


2 




3 


0 


3 


2 


2-3 


1-2 


2-3 


1 


308 




2 


3 


3 


2 


0 


1 


2 


1 


3 


1 


309 




2 


3 




2 


0 


I 


3 


1-2 


3 


0-1 


314 


3 


3 




1 


i 


0-1 


1 


1 


0 


1 


0 


316 




2 




2* 


0 


0 


1 


1 


0-1 


1 


0 


322 




* 




1 


2 


0 


1 


1-2 


0 


1 


0 


342 




* 






1 


0 


1 


3 


1-2 


1-2 


0 


345 




3 




2 


3 


I 


2 


3 


2 


3 


0-1 


352 




3 




4 


1 


0 


1 


3 


1-2 


3 


1-2 


365 




3 


2 


2 


2 


0-1 


2 


4 


3 


4 


2-3 


372 


2 


2 


2 




3 


1 


2 


2 


0 


1 


0 


374 




3 




2 


0 


0 


0-1 


3-4 


2-3 


3 


0-1 


377 




2 




2 


0 


1 


0-1 


1-2 


0-1 


2-3 


0 


378 


2 


2 




2 


0 


1-2 


1-2 


1-2 


0-1 


1-2 


0 


379 




1 




1 


0 


0 


! 


1-2 


0 


1 


0 


380 




1 




1 


1 


0 


0-1 


2-3 


2-3 


i-2 


1 


381 




2 


3 




2 


1 


1-2 


4 


3 


4 


-> 


388 


2 


2 




2 


3 


2 


1 


4 


3 


4 


1 


390 




2 




2 


0 


0 


1 


4 


1 


4 


0 


396 




4 




3 


0 


1 


2 


4 


3 


2 


0 


397 




3 




3 


0 


2 


2 


4 


3 


4 


0 


398 




4 






0 


0 


1 


3 


-> 


2 


0 


399 


3 


3 




2 


1 


4 


4 


4 


3 


■3 


0 


515 


*> 


-i 




1 


0 


0-1 


1 


2 


1 


2-3 


1-2 


517 




1 




1 


0 


2 


"> 


1 


2 


1 


1 


530 


2 


2 






1 


3 


3 


2 


2 


1 


0 
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Dye 


Bacteria 




Yeast 




Eukaryotes 
















Live 


Dead 


Fixed/ 
Permeabilized 




Live 


Killed 


DNA 


1 

Mi toe h 


Cyto 
Bke 


Nucl 


Cyto 


Nuc 
1 


Cyto 


Nucl 


Cyto 


AA^ 

993 


3 


3* 


Z 


Z 


1 

1 


u- 1 


T 


J 


2 


3 


0-1 


996 


3 


3 




•> 
Z 


Z 


4 


3 


J 




4 


0-1 


1004 












4 


1 A 

3-4 


4 


4 


A 
•4 


J-** 


1 107 




2 




J 


U 


A 1 

0-1 


1 

1 


Z- J 


1 


1 1 
L' J 


1 
1 


1 1 14 




3 


2 


Z 


Z 


A 


1 

1 


A 

4 


z 


A 


fi 1 
U- 1 


1148 


2 


2 




2 


1 
J 


Z 


z 


Z 


1 
I 


2. 


o 


1151 




3 


2 


*> 
2 


3 


A 
U 


n i 


*4 


J 


4 


J 


1155 




2 






0 


U- 1 


Z 


-1 
J 


t 


J 


0 


1 167 




3 




1 


a 
U 


A 

U 




7 
J 


-> 


J 




1 168 




3 




z 


1 
J 


A 

u 




z- J 


1 *i 




o 


1 169 




3 




i 
i 


J 


1 

1 


1 9 
1 -z 


4 


J 


4 


0-1 


11 70 




3 


*> 
2 




1 


f\ 

V 




z 


1 
1 


z- J 


n 


1172 




4 




4 


U 


0-1 




Z-J 


U- 1 


z 


f\ 

V 


1 174 


4 


4 




*> 


Z 














1178 




1 






0 


0 




1 




1 


u 


1182 


1 


1 




1 


0 


A 
U 




n_ i 

U 1 


i 

i 


1 


q 


1184 


2 


2 




2 


3 


2 




2 


1 


2 


0 


1189 




1 




1 


0 


0-1 




4 


3 


4 


4 


1 1 AA 

3 100 


2 


2 




i 
i 




0-1 




I 


0-1 


1 


0 


3102 




4 


3 


3 


-> 


0 




4 


3 


4 


3 


3103 


4 


4 




3 


2 


3 


3 


4 


2-3 


4 


3 


10101 




3 


3 




3 


0 


0-1 


3 


2 


2-3 


0 



0 



25 



30 



KEY 

Scale of brightness, I = dim, 4 = bright 

Killed - 70% Isopropanol killed. Dead - 3 7% formaldehyde killed, Fixed/Perrneabihzed - Dead, then acetone fixed 

DNA - Stains DNA spot on Yeast 

Mitoch - Stains mitochondria, either spotty or whole 

Cyto Bkg - Cytoplasmic background, 0 = no background, 4 = high background 
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The sample is combined with ihe staining solution by any means that facilitates contact between the dye and the 
; nucleic acid, typically through simple mixing. Where the sample is a solution, the staining solution is added to the 

5 sample solution directly or in a liquid separation medium such as an electrophoretic liquid, sieving matrix or running 
<jj buffer, or in a sedimentation (^.g. sucrose) or buoyant density gradient (e.g. containing CsCl), or on an inert matrix such 

as a blot or gel, a testing strip, or any other solid or semi-solid support. Suitable supports also include, but are not 
ft limited to, polymeric micropanicles (including paramagnetic microparticles), polyacrylamide and agarose gels (both 

|j denaturing and non-denaturing), nitrocellulose filters, computer chips (such as silicon chips for photolithography), 

10 natural and synthetic membranes, liposomes and alginate hydrogels, and glass (including opUcal filters), and other silica- 
based and plastic support. The dye is optionally combined with the nucleic acid solution prior to undergoing gel or 
'*! capillary electrophoresis, gradient centrifugauon, or other separation step, during separation, or after the nucleic acids 

^ undergo separation Alternatively, the dye is combined with an inert matrix or solution m a capillary prior to addition of 

the nucleic acid solution, as in pre-cast gels, capillary electrophoresis or preformed density or sedimentation gradients. 

15 

Where the nucleic acids are enclosed in a biological structure, the sample is typically incubated with the dye 
but any other technique that is suitable for transporting the dye mto the biological structure can be used. Some cells 
^| actively transport the dyes across cell membranes (e.g. endocytosis or ingestion by an organism or other uptake 

i& mechanism) regardless of their cell membrane permeability. Suitable artificial means for transporting the dyes (or pre- 

20 formed dye- nucleic acid complexes) across cell membranes include, but are not limited to, action of chemical agents 
such as detergents, enzymes or adenosine triphosphate; receptor- or transport protein-mediated uptake; liposomes or 
alginate hydrogels; phagocytosis or other types of ingestion; pore-forming proteins; microinjection; electroporation; 
hypoosmotic shock; or minimal physical disruption such as scrape loading, patch clamp methods, or bombardment with 
solid particles coaled with or in the presence of the dyes Preferably, where intact structures are desired, the methods for 
25 staining cause minimal disruption of the viability of the cell and integrity of celt or intracellular rm -nbranes. 

Alternatively, the cells are fixed and treated with routine histochemicai or cytochemicai procedures, particularly where 
pathogenic organisms are suspected to be present. The cells are typically fixed immediately after staining with an 
aldehyde fixauve that keeps the dye in the cells. The fixation of cells produces extensive cross-linking within the 
cellular membranes, so that membranes that were intact at the time of fixation remain impermeable to the dead cell stain 
Pathogenic bacteria can therefore be assayed for viability after fixauon, reducing the risk of exposure Typically cells 
are fixed using a pH-buffered fixative, such as 3.7% formaldehyde or 4% glutaraldehyde. Upon fixation, the sample 
cells are preferably washed to remove excess fixative, then stained. In some cases, live or dead cells are fixed prior to 
^ staining without substantially increasing cell membrane permeability of previously live cells so that onlv cells that were 

already dead prior to fixation slam with the cell-impermeant dye. 
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The sample is combined with the dye for a lime sufficient to form the fluorescent nucleic acid-dye complex, 
preferably the minimum time required to give a high signal-to-background ratio. The optimal time is usually the 
minimum time required for the dye, in the concentration being used, to achieve the highest target-specific signal while 
avoiding degradation of the sample over time and minimizing all other fluorescent signals due to the dye For example, 
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where the dye is chosen to be selective for a particular nucleic acid polymer or type of cell, the optimal lime is usually 
the rninimum time required to achieve the highest signal on that polymer or type of cell, with little to no signal from 
; other nucleic acids or other cell types. 

5 Preferably, the dye is combined with the sample at a temperature optimal for biological activity of the nucleic 

$j acids v/ithin the operating parameters of the dyes (usually between 5 °C and 50 °C, with reduced stability* of the dyes at 

higher tOTperatures). For tit vitro assays, the dye is typically combined with the sample at about room temperature (23 
f| °C). At room temperature, delectable fluorescence in a solution of nucleu acids is essentially instantaneous depending 

|j on the sensitivity of the instrumentation that is used; fluorescence in solutions is generally visible by eye within 5 

1 0 seconds after the dye is added, and is generally measurable within 2 to 5 rrunutes, although reaching equilibrium staining 
^ may take longer. Gel staining at room temperature usually takes from 5 minutes to 2 hours depending on the thickness 

' of the gel and the percentage of agarose or polyacryl amide, as well as the degree of cross-linking. Typically, post- 

al stained minigels stain to equilibrium in 20-30 minutes. For cells and other biological structures, transport of dyes across 

membranes is required whether the membranes aie intact or disrupted. For preferred embodiments, visibly detectable 
1 5 fluorescence is obtained at room temperature within 1 5-20 minutes of incubation with cells, commonly within about 5 
minutes. Some embodiments give detectable fluorescence inside cells in less than about 2 minutes. Lymphocytes 
loaded with 5 uM dye solutions give a fluorescence response in less than 5 seconds. This property is useful for 
^ observing nuclear structure and rearrangement, for example such as occurs during mitosis or apoptosis. 

20 Fluorescence of the Dye-Nucleic Acid Complex 



The nucleic acid-dye complex formed during the staining of the sample with a dye of the present invention 
comprises a nucleic acid polymer non-covalently bound to one or more molecules of dye. The combination of dye and 
nucleic acid results in a fluorescent signal that is significantly enhanced over the fluorescence of the dye alone. Where 
25 the fluorescence of the dye-nucleic acid complex decreases at pH lower than 6.5 or greater than 8. it is typically restored 
by returning to moderate pH. 

The quantum yield of unbound dye is typically O.01 , usually O.002, and frequently O.00 1 , which would 
yield a maximum enhancement of > I OOx, >500x, and > 1 OOOx respectively. For most applications, dyes are selected to 

30 give a quantum yield greater Lhan about 0.3, preferably greater than 0.6, when bound to nucleic acid. The level of 

fluorescence enhancement of the bound dye is generally about 100-1000 fold greater than that of unbound dye, typically 
greater than about 200-fold, such that the dyes have a readily detectable increase in quantum yield upon binding to 
nucleic acids. More typically, the fluorescence enhancement is greater than 300-fold, preferably greater than 1000 fold 
The molar absorptivity (extinction coefficient) at the longest wavelength absorption peak of the dyes is typically > 

35 50,000 and frequently > 60,000 for the dyes where n = 0. for dyes where n = 1 or 2, the molar absorptivity is typically 
greater than 90,000. Dyes with high extinction coefficients at the excitation wavelength are preferred for the highest 
sensitivity. 

A useful level of quantum yield in combination with other attributes of the subject dyes, including selectivity 
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Table 7: Quantum Yields of Indicated Nucleic Acid/Dye Complexes 
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DYE 


ExVEm. 


ds DNA 


RNA 


ss DNA 


oligos 


ethidium bromide 


526/605 


0.16 


0.07 






thiazole orange 


509/525 


0.20 








TOTO-1 


514/530 


0.40 




0.12 




TO-PRO-1 


515/530 


0.19 


0.16 






224 


470/496 


0.85 


0.73 


0.70 


0.74 


309 


496/518 


069 


0.53 


0.44 




314 


618/634 


0 16 


0.18 






316 


617/634 


0.16 


0.17 






345 


479/500 


0.90 


0.79 


0.64 


0.75 


352 


488/507 


0.23 


0.31 






377 


492/521 


0.70 


0.47 






378 


485/516 


0.63 


0.46 






379 


527/570 


0.10 


0.12 






381 


506/527 


0.37 


0.33 






388 


519/555 


0.13 


0.20 






396 


472/499 


0.84 


0.87 


0.72 


0.82 


398 


475/499 


0.87 


0.77 


0.86 


0.83 


410 


470/496 


0.92 


0.87 


0.75 


0.80 


6101 


504/524 


0.39 


0.39 


0.21 


0.31 


756 


513/539 


0.17 








937 


494/521 


0.73 




0.39 




993 


500/523 


0.57 


0.53 






996 


511/532 


0 16 


0.22 






1004 


492/513 


0.36 


0.54 






1107 


494/522 


0 67 








1114 


502/523 


0.53 


0.37 






1120 


498/521 


0.22 


0.20 


0.09 


0.12 


1155 


511/539 


0.11 


0.13 






1167 


509/551 


0.08 


0.11 






1168 


498/523 


0.62 


0.48 






1169 


508/541 


0/09 


0.13 
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|| 1170 


498/522 


0.57 


0.46 






II 1172 


492/520 


0.66 


0.46 
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Fluorescence properties of dyes. Quantum yields of selected dyes bound to double-stranded calf thymus DNA (ds 
5 DNA), E. coli nbosomal RN A, single-stranded M 1 3 phage DNA (ss DNA) and oligonucleotides (a synthetic 24 mer). 
Fluorescence excitation and emission maxima on double- stranded DNA are indicated; units are nm. 

The fluorescence of the complex is detected qualitatively or quantitatively by detection of the resultant light 
emission at a wavelength of greater than about 450 nm, preferably greater than about 480 nm, more preferably at greater 

10 than about 500 nm. Dyes having a quinolinium nng system usually absorb and emit at longer wavelength maxima than 
similarly substituted dyes having a pyndiruum ring system. The emission is detected by means that include visual 
inspection, CCD cameras, video cameras, photographic ..jn, or the use of current instrumentation such as laser scanning 
devices, fluoromeiers, photodiodes, quantum counters, plate readers, epifluorescencc microscopes, scanning 
microscopes, confocal microscopes, flow cytometers, capillary electrophoresis detectors, or by means for amplifying the 

1 5 signal such as a photomultipiier tube. Many such instruments are capable of utilizing the fluorescent signal to sort and 
quamitate cells or quantuate the nucleic acids, e.g. image analysis systems or flow cytometers (Examples 47, 48, 49). 
Dyes can be selected to have emission bands that match commercially available filler sets such as that for fluorescein or 
for detecting multiple fluorophores with several excitation and emission bands. 

20 Use of Complex 



Once the dye-nucleic acid complex is formed, its presence may be detected and used as an indicator of the 
presence, location, or type of nucleic acids in the sample, or as a basis for sorting cells, or as a key to characterizing the 
sample or cells in the sample (Tables 6-9 and 1 2; Example 41). Such characterization may be enhanced by the use of 
25 additional reagents, including fluorescent reagents. Attachment of covaient labels to the polymers used to form the dye- 
nucleic acid complex does not prevent subsequent formauon of the fluorescent complex (Figure 2; Example 33). In 
addition to use in qualitative analysis, the nucleic acids in a sample can also be quantified by comparison with known 
relationships between the fluorescence of the nucleic acid-dye complex and concentration of nucleic acids in the sample 
(Examples 21 , 22, 38, 48; Figures 3, 4, 10). 

30 

The dyes <? f *e invenuon give a strong fluorescent signal with small nucleic acid polymers (as few as 8 bases 
or base pairs with some embodiments) even with very small amounts of nucleic acids. Using a fluorescence 
microscope, a single nucleic acid molecule can be detected (Example 37) Nucleic acid content from as few as 5 
mammalian cells can be detected in cell extracts (Example 38). As little as 25 picograms of ds DNA/mL of solution is 

35 detected in a fluorometer (Example 21). In conjunction with an ultraviolet transilluminator, it is possible to detect as 
little as 10 picograms of ds DNA per band in an electrophoretic gel (Example 19); some dyes give such a bright signal 
even with illumination by ordinary fluorescent room lights, that as little as 1 ng DNA per band is detected. When used 
for pre- or post-staining of electrophoresis gels, the high sensitivity of the dyes of the present invention allows the 
detection of previously immeasurable amounts of nucleic acids using inexpensive instrumentation (e.g. UV trans- and 

40 epi-illuminators) without requiring destairung (see Table 8) 
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Table 8: Sensitivity of nucleic acid detection in electrophoretic gels 
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Dye Name 


DNA 
(254 am) 


DNA 

(300 am) 


RNA 

(254 am) 


RNA 

(300 am) 


ethidium bromide 




500 pg 




15 ng 


thiazole orange 


1-2 ng 








oxazole yellow 


300-600 pg 








395 


20-30 pg 


9C-100?g 


300 pg 


2 ng 


630 


30-40 pg 


9C-100pg 


300-400 pg 


1-2 ng 


YO-PRO-I 


60 pg 


180-200 pg 


100-200 pg 


580 pg 












211 


20 pg 


150-200 pg 


100 pg 


500 pg 


322 


250 pg 


1 ng 


300 pg 


2-3 ng 


345 


30-40 pg 


90-1 00 pg 


100-200 pg 


900 pg 


352 


30-40 pg 


90-1 00 pg 


200-300 pg 


900 pg 


374 


100 pg 


500 pg 


500 pg 


1-1.2 ng 


377 


20 pg 


60 pg 


100-200 pg 


1 ng 


378 


10-20 pg 


60 pg 


100-200 pg 


1 ng 


381 


10-20 pg 


80-1 00 pg 


300 pg 


1 ng 


388 


60 pg 


300 pg 


100 pg 


300-500 pg 


390 


30-40 pg 


90-1 00 pg 


200 pg 


2 ng 


396 


30-40 pg 


150 pg 


100-200 pg 


800-900 pg 


398 


30-40 pg 


150pg 


100 pg 


500 pg 


410 


20 pg 


100 pg 


200 pg 


2ng 


937 


10-20 pg 


50-60 pg 


200 pg 


800-900 pg 


1004 


20 pg 


60 pg 


100 pg 


300-500 pg 


1151 


20 pg 


80-100 pg 


300 pg 


1 ng 


1169 


60 pg 


150-180 pg 


300 pg 


1 ng 


1170 


20-30 pg 


60 pg 


300 pg 


1 ng 


1172 


20-30 pg 


60 pg 


200 pg 


900 pg 


3100 


700 pg 


> I ng 


300 pg 


900 pg 



For each test, a dilution series of A.cI857 DNA cut with Hind III restriction endonuclease or a dilution series of E. coli 
ribosomal RNA was electrophoresed in 10 cm x 10 cm x 0 4 cm 1% agarose gels. Gels were poststained with a 1 jjM 
solution of each dye in TBE buffer for 20 minutes and photographed through a Wratten 1 5 gelatin filter, with Polaroid 
black and while print film, using 254 nm epi-illumination or 300 nm transillumination as indicated. Numbers indicate 
the amount of nucleic acid in the lowest intensity band that was visible in the Polaroid photograph; bands were 3 .5 mm 
wide. 



35 



BNSDOCID: <WO 9613S52A2_I_> 



WO 96/13552 PCI7US95/13706 

Alternatively, the presence or locauon of nucleic acids, stained as above, can in turn be used to indicate the 
presence or locauon of organisms, cells, or organelles containing the nucleic acids, where the presence or locauon of the 
fluorescent signal corresponds to the presence or location of the biological structure (e.g. stained cells or organelles). 
Infective agents such as bacteria, mycoplasma, mycobacteria, viruses and parasitic microorganisms, as well as other 
5 cells, can be stained and delected inside of eukaryoie cells, although the fluorescent signal genercied by an individual 
ffi virus particle is belnw the resolution level of standard detection instrumentation. In a further embodiment of Uie 

invention the fluorescent signal resulting from formation of the dye-nucleic acid complex is used as a basis for sorting 
& cells, for example sorting stained cells from unstained cells or sorting cells with one set of spectral properties from celli 

gj with another set of spectral properties (Examples 45, 47; Figures 8, 9). 

10 

^ In addition to detection of the presence or location of nucleic acids as well as their enclosing structures, the 

staining profile that results from the formauon of the dye-nucleic acid complex is indicative of one or more 
^ characteristics of the sample By staining profile is meant the shape, location, distribution, spectral properties of the 

profile of fluorescent signals resulting from excitation of the fluorescent dye-nucleic acid complexes. The sample can be 
1 5 characterized simply by staining the sample and delecting the staining profile thai is indicative of a characteristic of the 
sample More effecti ve characterization is achieved by utilizing a dye that is selective for a certain characteristic of the 
sample or by utilizing an additional reagent (see below), where the additional reagent is selective for the same 
H characteristic to a greater or lesser extent or where the additional reagent is selective for a different characteristic of the 

^ same sample. 

20 

In one embodiment of the invention, integrity of cell mebranes is determined by staining cells as above for a 
time period and dye concentration sufficient to give a detectable fluorescent signal in cells with compromised 
membranes. Where the dye selected is impermeant to cells with intact membranes, formauon of the fluorescent dve- 
nucieic acid complex inside the cell is indicative that the integrity of the cell membrane is disrupted and the lack of 
25 fluorescent dye-nucl ;:c acid complexes inside the cell is indicative that the cell is intact or viable. The impermeant dye 
is opuonally used in conjunction with a counterstain that gives a detectably different signal and is indicative of 
metabolicaily active cells or, in combination with the impermeant dye, is indicative of cells with intact membranes. 
Alternatively, the more permeant dyes of the invention are used to stain both cells with intact membranes and cells with 
disrupted membranes, in conjunction with a counterstain that gives a detectably different signal in cells with disrupted 
membranes, allowing the differentiation of viable cells from dead cells. The counterstain thai gives a detectably different 
signal in cells with disrupted membranes is optionally an impermeant dye of the invention or another reagent that 
indicates loss of integrity of the cell membrane or lack of metabolic acuvity of the dead cells. When the cells are stained 
with a concentrauon of dye that is known to stain live bacteria, the relative reduction of a fluorescence intensity can be 
used to distinguish quiescent bactena, which are not actively expressing proteins, from metabolicaily active bacteria 
35 (Figures 8A & 8B. Example 45). 
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in a further embodiment of the invention, the shape and distribution of the staining profile of dye-nucleic acid 
complexes is indicative of the type of cell or biological structure that contains the stained nucleic acids. Cells may be 
discriminated by eye based on the visual fluorescent signal or be discriminated by instrumentation as described above, 
based on the spectral properties of the fluorescent signal. For example, dyes that are non-selective for staining nucleic 
5 acids in intracellular organelles can be used to identify cells that have an abundance or lack of such organelles, or the 
presence of micronuclei and ouVr abnormal subparticles containing nucleic acids and characteristic of abnormal or 
diseased cells. A sample may be characterized as containing blebbing cells or nuclei based on the visible staining 
$ profile. Dyes that ve selective for the nucleic acids in a particular organelle (e.g. in nucleus, mitochondria, 

:^ miiochondrial nucleoids), even in the presence of limited staining of nucleic acids in the cytoplasm or other organelles, 

10 can be used to characterize cells as containing or lacking such organelles based on the intensity as well as the location of 
the signal, allowing the use of instrumentation to characterize the sample. Typically the staining profile used to 
characterize the sample is indicative of the presence, shape, or location of organelles or of cells, where the cells are 
located in a biological fluid, in a tissue, or in other cells Dyes that give a distribution of fluorescence intensity signals 
that reflects the distribution of DNA content of a cell population can be used for cell cycle analysis. 

15 

In another embodiment of the invention, the staining profile results from the formation of the dye-nucleic acid 
complex in an electrophoretic gel, or sedimentation or centrifugation gradient. In addition to indicating the presence of 
^ nucleic acids in the gel, the staining profile is indicative of one or more characteristics of the nucleic acid solution 

^ applied to the gel. The number of bands and/or the intensity of the signal per band of the staining profile, for example, is 

20 indicative of the purity or homogeneity of the nucleic acid solution. Band tightness and degree of smearing is indicative 
of the integrity of the nucleic acid polymers in the solution. The size, conformation, and composition of the polymers, 
are indicated by the relative mobility of the polymer through the gel (Examples 34, 35), which can be used to detect 
changes caused by interaction of analytes with the nucleic acid polymer such as protein binding or enzymatic activity. 
Preferred embodiments of the dyes have low intrinsic fluorescence so there is no need to destain gels to remove free dye. 
25 Furthermore, the fluorescence of the dye-nucieic acid complex is not quenched by denaturants such as urea and 
formaldehyde, eliminating the need for their removal from the gels prior to staining. 

In yet another embodiment of the invention, the staining profile is indicative of the presence or predominance 
of a type of nucleic acid that is used to characterize the sample In one embodiment of the invention, the dye is chosen to 
30 be more selective for AT or GC rich polymers, such that staining profile is indicative of the relative proportion of these 
bases (Example 4 1 , Table 1 2). In another embodiment of the invention, the spectral properties of the nucleic acid-dye 
complex vary depending on the secondary structure of the nucleic acid present in the complex. Typically, the spectral 
properties will vary in fluorescence enhancement, fluorescence polarization, fluorescence lifetime, excitation wavelength 
or emission wavelength, preferably emission wavelength. A comparison of the fluorescence response of a sample of 
35 unknown nucleic acids with that of a stained nucleic acid of known secondary structure allows the secondary structure of 
the unknown nucleic acids to be determined, and the amount of nucleic acids in the sample to be quantified. In this 
manner, RNA and single-stranded DNA can be differenuated from double-stranded DNA (Example 40). Where 
nuclease is added to the nucleic acid polymers in solution or in fixed cells to digest the RNA or DNA prior to 
combining with the dye, the fluorescent signal from the dye-nucleic acid complex can be used to discriminate the nucleic 
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acid polymer that was not digested in the presence of the nuclease from undigested polymers (Example 39). 

This same property of sensitivity to secondary structure by monomethine dyes can be used to quantitate ds 
nucleic acids in the presence of ss nucleic acids. Samples containing both ds and ss DN A or RNA yield emission 
3 maxima in both the green and longer wavelength regions at high dye: base ratios Meaningful information about the 

amounts of ss and ds nucleic acids m solution r an be grthered by a direct comparison of uV spectra of the low dye ratio 
sample and high dye ratio sample. For example, where a nucleic acid solution such as purified oligonucleotides, DNA 
amplication reactions, a cDNA synthesis, plasmid preparation, or cell extraction is stained with a high dye 
concentration (i.e. greater than or equal to the concentration of nucleic acid bases), the fluorescent signal that results 
10 from complexes formed by ss nucleic acids is red-shifted from the fluorescent signal formed by ds nucleic acids. Where 
the dye is selected to give a high quantum yield with ds nuci ; acids and the quantum yield of the red-shifted fluorescent 
signal is minimal, the quantum yield of the stronger signal can be used to quantitate the amount of ds nucleic acid in the 
sample, even in the presence of ss nucleic acids (Example 40, Figure 6). 

,j 

1 5 The nucleic acids for this and other applications are quantitated by comparison of the detectable fluorescent 

signal from the dye-nucleic acid complex, with a fluorescent standard characteristic of a given amount of nucleic acid 
(Examples 21,22,38,39, 48). The reference value of fluorescence used for comparison with the fluorescence resulting 
|j from the formation of the dye-nucleic acid complex is determined from a sample of known nucleic acid content or from a 

$3 distribution of nucleic acid content in a given population of cells over time. Where one type of nucleic acid in a sample 

20 is selectively digested to completion, the fluorescent signal can be used to quantitate the polymer remaining after 
digestion (Example 39). Alternatively, prior to being stained, a solution of nucleic acid polymers is separated into 
discrete fractions using standard separation techniques and the amount of nucleic acid present in each fraction is 
quantitated using the intensity of the fluorescent signal that corresponds to that portion. The solution may be purified 
synthetic or natural nucleic acids or crude mixtures of cell extracts or ussue homogenates. Where aliquots from a single 

25 sample are taken over tune, and the nucleic acid content of each aliquot is quantitated, the rate of cell or nucleic acid 
proliferation is readily deierrnined from the change in the corresponding fluorescence over tune (Example 38), or from 
the change ui cell distribution over cell cycle compartments (Examples 48 and 49). 

In another aspect of the invention, the dye-nucleic acid complex is used as a fluorescent tracer or as probe for 
30 the presence of an anah" *■ In one aspect of the invention, the dye-nucleic acid complex is used as a size or mobility 
standard, such as in electrophoresis or flow cytometry. Alternatively, the fluorescent signal that results from the 
interaction of the dve \> ith nucleic acid polymers can be used to detect or quantitate the activity or presence of other 
% molecules that interact with nucleic acids. The nucleic acid polymers used to form the dye-nucleic acid complex are 

optionally attached to a solid or semi-solid support, or free in solution, or enclosed in a biological structure. Such 
35 molecules include drugs, other dyes, proteins such as histones or ds or ss DNA or RNA binding proteins, or enzymes 

such as endonucleases or topoisomerases In one aspect of the invention, a dye having a binding affinity for nucleic acid 
greater than that of the analyte being assayed displaces the analyte or prevents the interacuon of the analyte with the 
nucleic acid polymer For example, DNA templates that are heavily bound with a high affinity dye such as dye 1 1 1 4 
(i.e. ai rauos of greater than 3 bp:dye molecule in the staining solution) are protected from DNase I activity. Typically 
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the dyes having a dissociation constant less than 10* 6 M, more typically less than 10* 8 M, are effective to displace 
analytes that interact with nucleic acids. Dye affinity is determined by measuring the fluorescence of the dye-nucleic 
acid complex, fitting the resulting data to an equilibrium equation and solving for the association constant. In another 
aspect of the invention, dyes having a binding affinity that is less than that of the analyte being assayed are displaced 
from the dye-nucleic acid complex by the presence of the analyte, with the resultant loss of fluorescence. For example, 
lower affinity dye molecules p-ebour.d to double -srranded DNA are displaced by histones. 

In one embodiment, the complex is used as an indicator of enzymatic activity, that is, as a substrate for 
nucleases, topoisomerases, gyrases, and other enzymes that interact with nucleic acids (Example 24). Seme 
embodiments of the dyes inhibit non-specific nuclease activity but not restriction endonuclease activity at certain 
dye.bas" "sair ratios. Altei-natively, the complex is used to quanutate the abundance of proteins (such as histones) that 
bind nucleic acids, or of DNA binding drugs (such as distamycin, spermine, actinomycin, mithramycin, chromomycin). 
The fluorescent complex is combined with the sample thought to contain the analyte and the resultant increase or 
decrease in fluorescent signal qualitatively or quantitatively indicates the presence of the analyte. 

Additional Reagents 

The dyes of the invention can be used in conjunction with one or more additional reagents that are separately 
detectable. The additional reagents may be separately detectable if they are used separately, e.g. used to stain different 
aliquots of the same sample (e.g. Example 39) or if they stain different parts or components of a sample (e.g. Example 
42), regardless whether the signal of the additional reagents is detectably different from the fluorescent signal of the dye- 
nucleic acid complex. Alternatively, the dye of the invention is selected to give a detectable response that is different 
from that of other reagents desired to be used in combinauon with the subject dyes. Preferably the additional reagent or 
reagents are fluorescent and have different spectral properties from those of the dye-nucleic acid complex. For example, 
dyes that form complexes that permit excitauon beyond 600 nm can be used in combinauon with commonly used 
fluorescent antibodies such as those labelled with fluorescein isoihjocyanate or phycoerythrin. 

Any fluorescence detection system can be used to detect differences in spectral properties between dyes, with 
differing levels of sensiuviry Such differences include, but are not limited to, differences in excitauon and/or emission 
maxima, in fluorescence lifetimes, in fluorescence emission intensity at the same or different excitauon wavelengths, lp 
absorptivity, in fluorescence polarizauon, in fluorescence enhancement in combination with target materials, or 
combinauons thereof The detectably different dye is optionally one of the dyes of the invention having different spectral 
properties and different selectivity. In one aspect of the invention, the dye-nucleic acid complex and the additional 
detecuon reagents have the same or overlapping excitation spectra, but possess visibly different emission spectra, 
generally having emission maxima separated by > 10 nm, preferably >20 nm, more preferably >50 nm. Alternatively, 
the additional reagent(s) are simultaneously or sequentially excited at a wavelength that is different from that used to 
excite the subject dye-nucleic acid complex (e.g. Example 44). In yet another alternative, one or more additional 
reagents are used to quench or partially quench the fluorescence of the dye*nucleic acid complex, such as by adding a 
second reagent to improve the selectivity for a particular nucleic acid or the AT/GC selectivity. 



40 



BNSOOCID: <W0 9613552A2_L> 



WO 96/13552 " PCT/US95/I3706 

Improving on the procedure of Saitoh, et al. , CELL 76, 609 ( 1 994) for banding on metaphase chromosomes, 
■ j green fluorescent dyes of the invention bind essentially nonselective^ along the entire chromosome and are quenched by 

\ Methyl Green selectively binding in regions with high AT content. The result is a series of fluorescent green bands 

'■! separated by dimmer high AT regions that are characteristic of particular chromosomes (Example 27). This enables 

5 karyotype analysis and structural analysis, including the identification of genetic anomalies such as trisomies and 
% translo;>a:ions. 

M The dyes of the invention are generally not quenched by adding a halogenated deoxyundine (preferably bromo- 

Jj cr chloro-deoxyuridine). Therefore, dyes that overlap spectrally with bisbenzimidazole dyes (e.g. Hoechst 33258, 

10 Hoechsl 33342, Molecular Probes, Oregon) and bind to nucleic acids in close proximity to the bisbenzunidazole dyes 
can be used in conjunction with halogenated deoxyuridines and bisbenzimidazole dyes for the analysis of cell 
proliferation. The effect of the additional reagents in combination with the dyes of the invention is analysed by 
fluorescence quantifying instrumentation (Example 49). 



4 



1 5 Additional dyes are optionally used to differentiate cells or cell-free samples containing nucleic acids according 

to size, shape, metabolic state, physiological condition, genotype, or other biological parameters or combinations 
thereof. The additional reagent is optionally selective for a particular characteristic of the sample for use in conjuncuon 
with a non- selective reagent for the same characteristic, or is selective for one characteristic of the sample for use in 
% conjuncuon with a reagent that is selective for another characteristic of the sample. In one aspect of the invention, the 

20 additional dye or dyes are metabolized intracellularly to give a fluorescent product inside certain cells but not inside 
other cells, so that the fluorescence response of the cyanine dye of the invention predominates only where such 
metabolic process is not taking place. Alternatively, the additional dye or dyes are specific for some external component 
of the cell such as cell surface proteins or receptors, e.g. fluorescent lecuns or antibodies (Example 32). In yet another 
aspect of the invenuon, the additional dye or dyes actively or passively cross the cell membrane and are used to indicate 
25 the integrity or functioning of the cell membrane (e.g. calcein AM or BCECF AM). In another aspect, the additional 
reagents bind selectively to AT-rich nucleic acids and are used to indicate chromosome banding. In another aspect of 
the invenuon, the additional reagent is an organelle stain, i.e. a stain that is selective for a particular organelle, for 
example the additional reagent(s) may be selected for potential sensitive uptake into the mitochondria (e.g. rhodamine 
1 23 or tetramethylrosarnine) or for uptake due to pH gradient in an organelle of a live cell (e.g. Diwu, et al., 
30 CYTOMETRY supp. 7, • 77, Abstract 4 26B (1994 ^ 

The additional dyes are added to the sample in an effective amount, with the optimal concentrauon of dye 
|j determined by standard procedures generally known in the art. Each dye is optionally prepared in a separate solution or 

combined in one solution, depending on the intended use. After illumination of the dyed cells at a suitable wavelength. 
35 as above, the cells are analyzed according to their fluorescence response to the illumination. In addition, the differential 
fluorescence response can be used as a basis for sorting the cells or nucleic acids for further analysis or experimentation 
For example, all cells that "survive" a certain procedure are sorted, or all cells of a certain type in a sample are sorted 
The cells can be sorted manually or using an automated technique such as flow cvtometrv. according to the procedures 
: known in die art, such as in U.S. Patent 4,665,024 to Mansour, et al. (1987). 
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The examples below are given so as to illustrate the practice of this invention. They are not intended to limit or 
define the entire scope of this invention. 

Example 1 : Preparation of 1 .2-dihvdro-4-methvN 1 -phenvl^-quinolone (1) 
5 The following compound is prepared: 



10 




The synthetic precursor (1) is prepared according to Example 1 of U.S. Patent No. 5,436,134 to Hauglandet al (1995). 

Example 2: Preparation of 2-chloro-4-methvl- 1 ■phenvlquinolimum c hloride (2) 
The following compound is prepared: 




15 

To 2.8 g ( 1 1 .9 mmoles) of 1 in 20 mL of methylene chloride is added 1 .85 g of POCl 3 and a catalytic amount of 
dimethylformamide (Marson, TETRAHEDRON., 48, 3659 (1992)). The resulting mixture is heated to reflux for 24 
hours. The crude product is used without further purification, or is purified using column chromatography. 

20 The methoxyquinolinium analog is prepared in the same way. except using 1 ,2-dihydro-7-methoxy-4-methyl- 1 -phenyl- 
2-quinolone in place of 1 

Example 3 Preparation ofDve 640 

The commercially available 2-chloro-3-meihylquinoltne is methylated by heating with an excess of methyl iodide in a 
25 sealed tube at 1 20 °C for one hour. At the end of the reaction, ethyl acetate is added and the precipitate is filtered to 
isolate the quuiolmium iodide This intermediate compound is then stirred with 3-methyl-2- 

memyllhiobenzothiazolinium losylate in methylene chloride in the presence of one equivalent of tri ethylamine to yield 
the desired product 
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Example 4: Preparation of 2-chloro-4-r2.3-dihvdro-3-methvl-fbenzo-l J-thiazol-2-vlVmethvlideneH- 

phpnylqyinglinium kxi'te P) 

The following compound is prepared: 




Compound 3 is prepared according to Example 7 of U.S. Patent 5,436,134 toHauglandel a) (1995). 

The pyridiruum analog of Compound 3 is prepared in the same way, except using the pyridinium analog of 2. 

The trimethine dye analog is prepared similarly, except using 2-(2-amlmo\dnyl)0-methylbenzothiazolium tosylate in 
place of 3-methyl-2-memylthiobenzothiazolium tosylate. 

Example5 Preparation ofDve937 

Dye 937 is prepared by heating 3 at 55 °C in the presence of N-(3-dtaeuhylarninopropyl)*N-propylamine in 1,2- 
dichloroetheane for two hours. 

A family of analogous aminoalkylamino- substituted dyes are prepared similarly, by treating the appropriate 2-chloro 
derivative with a selected amine (For example Dyes 211, 298, 342, 377, 396, 397, 856, 938, 993, 1004, 1 168 and 
10101). 

Example 6. Preparation of Dye MQ7 

Dye 937 is treated with an excess of methyl iodide and PROTON-SPONGE (Aldrich) to methylate the dimethylamine 
and give the quaternary ammonium salt. A family of analogous ammomumalkylamino-subsututed dyes are prepared 
similarly, by treated an appropriate aminoalkyl amino- subsu ruled dye (See Example 5) with methyl iodide and 
PROTON-SPONGE (For example, Dyes 308, 309. 345, 398, 1 107, 1 1 14, 1 170, 1 172, and 3102). 

Example 7; Preparation of Dye 1 004 

2-Dmiemylaminoethanethiol is added to 2-chioro-4-(2,3-oihydro-3-methyl-(benzo-l,3-oxa2ol-2-yl)-methylidene]-l- 
phenylqumolinium iodide (the benzoxazolium anaJog of 3) in methylene chJonde, followed by triethylamine, and the 
resulting mixture is stirred at room temperature for 1.5 hours The volume of solvent is reduced under reduced pressure 
and the product is isolated by filtration. 

A family of analogous aminoal'cylthioether- substituted dyes is prepared similarly, by treating the appropriate 2-chioro 
derivative with a selected ammoalkylthiol in the presence of one equivalent of triethylamine (For example Dyes 365, 
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380, 387, 996, 1004, and 1 169). The resulting dyes are quatemized using the method of Example 6 to yield the 
corresponding arnmomumalkylthioether-substituted dyes (For example Dyes 352, 391 , 1 1 55, and 1 167). 

I 

Example 8. Preparation of Dves 3 1 4 and 3 1 6 
5 The l,2-dihydro-4-methyl-l-phenyl-2-quino!ont- :^ated at reflux with 1.3 equivalents of phosphorus oxychloride and 
v$ 1 equivalent of DMF in toluene for one hour to generate the 2-chloro-4-methyl- 1 -phenyl quinolinium chloride (3). The 

chloride is then stirred in the corresponding dirnethylaminoethanethiol in methylene chloride to produce the 
$ corresponding 2-cUmethylaminoethylthio-l -phenylquinolinium chJor.de This is then leacted with one equivalent each 

i| of the 2-(2-aiulmovinyl)-3-methyl-benzoxa2olium tosylate, tri ethyl amine and acetic anhydride to generate the 

• 10 corresponding trirnethine derivative. 



*1 



The dimethylamino derivative is quatemized using excess methyl iodide and PROTON-SPONGE to yield Dye 316. 

Example 9. Preparation ofDve38l 

1 5 The starting 1 ,2-dihydro-4-methyl- 1 -(4'-methoxyphenyl)-2-quinolone is prepared by an Ullmann reaction of the 2- 
hydroxy-4-methylquinoline with 4-iodoanisole The methyl ether is demethylated with boron tribromide and the 
resulting phenol is alkylated in acetone with 3 -dimethyl arrunopropyl chloride and potassium carbonate to yield the 
dimethylarrunoalkylether quinolone. To this quinolone in THF at -78 °C is added 3 equivalents of n-butyllithium. After 
one hour at low temperature the reaction is quenched with 5 equivalents of acetic acid and allowed to warm to room 

20 temperature, where it is stirred for an additional several hours. The volatile components are removed under vacuum and 
the resulting crude quinolinium salt is stirred with 3-methyl-2-methylthiobenzothiazolium tosylate in methylene chloride 
in the presence of triethylamine to generate the corresponding 2-buryl-l-((3 , -dtoemylarnmopropoxy)phenyl)-cyanine, 
which is quarternized as above with methyl iodide and PROTON-SPONGE to yield the desired product. 

25 Example 10. Preparation ofDve374 

The procedure is similar to that used to prepared Dye 381 (Example 8) except that 1 ,2-dihydro-7 (3'- 
dimethylarrunopropoxy)-4-methyl- 1 -phenyl-2-quinolone is used as the starting material instead of 1 ,2 -dihydro-4 -methyl - 
l-(4'-(3 M -cUmemylamJLnopropoxyphenyl))-2-quinolone 

30 Example 1 1 . Preparation of Dve 3 100 
The following compound is prepared 
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« 2,4-Lutidwe is heated with methyl iodide in a sealed tube at 100 °C to generate the pyriduuum iodide, which is then 

treated with the 3-methyl-2-methylthiobenzothiazolium tosylate in the presence of one equivalent of triethylamine to 
generate the desired product. 

5 Example 12. Preparation ofDve3103 
% The corresponding 2-chJoro derivative is heated at about 90 °C, in a sealed tube, in a 1 : 1 v/v mixture of 

chloroform/methanol for 10 hours to yield the desired product. 

if Example 13. Preparation ofDve 388 

10 To 1,2-dimethyM-qumolone in THF at -78° C, is added 3 equivalents of 4-dieUiylamjnomethylphenyllilmum. The 
reaction rruxtu is stirred at room temperature for one hour, after which 5 equivalents of acetic acid is added, the 
mixture is warmed io room temperature and stirred for an additional 3 hours All the volatile materials are removed 
# under vacuum and the crude residue is stirred with one equivalent each of 3-methyl-2-methylihiobenzothiazolium 

* tosylate and uiethylamine in methylene chloride to yield the diethyl aminoalkyl derivative. This is quarternized directly 

1 5 with excess methyl iodide and PROTON-SPONGE to yield the desired product. 

Example 14. Preparation of Dve 390 
j|j Dye 390 is prepared analogously to Dye 388, except using 1 ,2-dihydro- 1 ,4 -dimethyl -2-quinolone in place of 1 ,2- 

$ dimethyl-4-quinolone. 
20 

Example 15. Preparation of Dve 380 

4-Duiiemylaminoburyryl chloride is treated with one equivalent of 5-anuno- 1 ,3,4-thiadiazole-2-thiol (Aldrich) in the 
presence of triethylamine to generate the corresponding amide thiol. This intermediate product is then treated with 2- 
chloro-4-[2,3-dihydro-3-meuiyl-(benzo-l ,3-thiazol-2-yl)-methylidene]-l -phenylquinolium iodide to yield the desired 
25 product. 

Example 16. Preparation of Dve 1 189 

A soluuon of 2-cWoro-4-(2,3-dihydroO-methyl-(ben iodide is 

treated with 4-arninothiophenol to yield the corresponding 2-(4'-anunothiophenoxy) denvauve. The aniline is then 
30 reacted with 4-bromoburyryl ch'^de (Lancaster) to yield the 4-bromobutyramide. This intermediate is heated with 
excess pyridine to yield the final product. 



•a 



y Example 1 7 Preparation of Dve 517 



■si 



To 1 ,2-dimethy. methoxy-quinolinium iodide in methylene chloride is added one equivalent each of 2-(2- 
35 anilinovinyl)-3-methylben20lhiazolium tosylate, triethylamine and acetic anhydride, in that order. The reacuon is stirred 
at room temperature overnight to yield the product. 

Example 18 Preparation of Dve 300 
The following compound is prepared: 
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2,4-dimethylquinoline is heated with 10 equivalents of 1,3-diiodopropane, neat, at i 50 °C to generate the quinolimum 
|£ iodide. The iodide is then reacted with 3-methyl-2-metiiylihiObenzoxazolium tosylate in the presence of one equivalent 

5 of tnethylamine to generate the 1 -iodopropyi intermediate, which in turn is transformed to the final product by heating 
with a large excess of tnmethylamine in a sealed tube at 100 °C 

Example 19. ds DNA in electroohoretic gel 
^ A dilution series of <J>X 1 74 replicative form (double- stranded) bacteriophage DNA digested with either Hae III 

( 1 0 restriction endonuclease or A. c 18 57 bacteriophage DNA digested with Hind III restriction endonuclease (both DNAs 

available commercially) is prepared in 10 mM Tris-HCl, pH 7.5, 1 mM ethylenediamine tetraacetic acid (EDTA) (TE). 

An equal volume of 1 5% FICOLL is added to each sample and samples are loaded onto a 5% polyacrylamide gel for the 

Hae III digest or to a 1 % agarose gel for the Hind III digest. Electrophoresis is carried out under standard conditions. 
|j The resulting gels are transferred to small staining dishes containing a 1 uM solution of Dye 377 in 89 mM Tris base, 

^ 1 5 89 mM bone acid, 1 mM EDTA, pH 8 (TBE). The staining solution is then covered with foil to protect it from room 

light and agitated gently for 15-30 minutes. The gels are then transferred directly to a transilluminator and photographed 

using 300 nm transillumination or 254 nm epi -illumination, black and white Polaroid 667 print film and a Wratten 1 5 

gelatin filter. DNA appears visually as bright green fluorescent bands. 



20 Example 20. ss, nvclejc acids m elcctrpphvTCUc gels 

Native or denatured electrophoretic gels of a dilution series of E. colt nbosomal RNA, M 1 3 singie-stranded DNA or a 
synthetic oligonucleotide are prepared using standard methods Gels are then stained with 1 uM Dye 388 in TBE and 
visualized as in Example 19. RNA and DNA bands appear as bright green fluorescent bands. 

25 Example 21. QuamiWiQn of foufle- Stran^ea 1 DNA in Wlv\\Qt\ 

A series of double- stranded DNA samples of unknown concentration is prepared in TE A wcrk:_-;g solution of 0 8 uM 
Dye 377 is prepared in TE and kept protected from light One mL of each DNA solution is placed in a fluorescence 
cuvette. One mL of working dye solution is added to each cuvette; the samples are mixed and incubated 2 to 5 minutes, 
protected from light. Fluorescence is measured in a standard fluorometer or microtiter plate reader, using 485 nm 

30 excitation light and measuring the emission at 520 nm. Fluorescence intensity is compared to a standard curve prepared 
from samples containing known DNA concentrations The concentration of DNA in the unknown samples is 
determined by interpolation of the data in the standard curve Samples containing DNA in excess of 1 ug/mL are diluted 
prior to quantitation. The assay is linear between about 25 pg/mL and 400 ng/mL in DNA concentration, as shown in 
Figure 3. The assay is about 20-fold more sensitive than can be achieved with either YOYO-1 or YO-PRO-1 (0.5-1 
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ng/raL), about 400-fold more sensitive than Hoechst 33258 (10 ng/mL) and about 40,000-fold more sensitive than UV 
absorbance measurements (-1 ng/mL). 

Example 22. Quantitation of single-stranded oligonucleotides in solution 

A series of single-stranded synthetic oligonucleotides, synthesized from standard or morpholine-modifled derivatives 
(AntiVirals Inc., Corvallis, OR), at least 8 bases in length, in solutions of unknown concentration are diluted to 1 mL in 
TE in fluorescence cuvettes. One mL of a 0.5 uM solution of Dye 3C9 in TE is added to each sample, and the samples 
are incubated for 2-5 minutes at room temperature, protected from light. The samples are illuminated at 485 nm and the 
fluorescence of each sample is measured at 520 nm. The concentration of each solution is determined by comparison 
with a standard curv e prepared using known amounts of oligonucleotides, as shown in Figure 4 Samples containing in 
excess of about 1 ug/mL nucleic acid are diluted prior to analysis. Samples containing as little as about 100 pg/mL 
synthetic oligonucleotide with standard bases and links can be assayed. Samples containing morpholine modified links 
arc detected at lower sensitivity, with such sensitivity being a function of sequence. Oligonucleotides of at least 8 bases 
in length can be measured. This sensitivity is greater than 10,000 times more sensitive than measurement of UV 
absorbance, which is the current method most commonly used for oligonucleotide detection and quantitation. 

Example 23. Detection of oligonucleot ides in blood 

Whole blood is collected in vials containing EDTA. 0.5 mL aliquots of blood are transferred to 1 .5 mL microfuge tubes. 
To each sample is added a 24 base oligonucleotide, in as small a volume as possible ( 1 to about 50 uL), in amounts 
ranging from 1 ng total up to about 10 ug total. Blood cells are pelleted by centrifugation in the microfiige for 1-2 
minutes at 5000 rpm, at room temperature. The supernatant liquid is removed to fresh tubes, without disturbing the 
pellet Remaining cells are removed by recentnfugation for 1-2 minutes at 10,000 rpm, at room temperature. The 
supernatant liquid is again carefully transferred to fresh tubes, without disturbing the pellet. An equal volume of 
phenol :CHCl 3 :isoamy I alcohol, 24:24: 1 is added to each tube, and the tubes are vortexed vigorously and centrifuged in 
the microfuge to separate phases (room temperature). The aqueous layer is removed to fresh rubes, carefully avoiding 
the interface. The extraction is repeated. Aliquots containing 200 uL of each sample are transferred to fluorescence 
cuvettes containing 800 uL TE. One mL of a 0.5 uM solution of Dye 309 in TE is added to each cuvette and samples 
mixed by inversion. The amounts of oligonucleotides present are determined by subtracting the fluorescence observed 
from a control sample containing no oligonucleotide, according to the method outlined in Example 22. 

Example 24. Detection of DNase activity 

Samples thought to exhibit DNase activity are incubated at 37 °C for five minutes with 10 ng of 4>X174 RF (double- 
stranded) DNA, digested with Pst I restriction endonuclease, in a buffer consisting of 50 mM Tris-HCl, pH 7.5, 10 mM 
MgCl 2 , 1 mM CaCU, and 50 ug/mL bovme serum albumin in a total volume of 10 uL. Reactions are quenched by the 
addition of 2.5 uL 100 mM EDTA and immediate vigorous mixing. An equal volume of 1 5% FICOLL is added to each 
sample and the samples arc mixed briefly, men loaded onto a 1% agarose minigel along with molecular weight markers 
containing 0.05% bromophenol blue tracking dye and 7.5% FICOLL. The gel is electrophoresed under standard 
conditions, unul the bromophenol blue has migrated at least 1 1/2 to 2 inches. The gel is then removed from the 
electrophoresis apparatus and placed in a staining dish. A solution containing 1 uM Dye 377 in TBE is added to the gel 
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and the gel is agitated gently, protected from light, for at least 20 minutes. The gel is transferred to a transilluminator, 
illuminated with 300 nm transillumination or 254 nm epi -illumination and photographed with Polaroid 667 black and 
; white print film, through a Wratten 1 5 gelatin filter. DNase activity appears as smearing of the single, sharp Pst I 

digested DNA band. As little as 6.5 pg or -2 x I0* 5 units of DNase I can be detected in this way. Restriction 
5 endonuclease activity or RMase activity can be assayed in a similar manner, using appropriate substrate nucleic acid 
molecules. 

§ ^ is gcneraiizable for topoisomerases, gyrases, restriction endonucleases, RNases, exonucleases, or any enzyme 

|j that acts on DNA in such a way that its electrophorettc mobility is altered. 

10 

Example 25. Detection of nucleic acids on a support 

Piasmid pUC 1 9 DNA is digested overnight with a single restriction endonuclease or a mixture of two enzymes. One ug 
ws of each sam P Ie is hen loaded onto a 5% polyacrylamide gel and electrophoresed according to standard procedures. The 

gel is then stained with Dye 398 as described in Example 1 9 above. Bands are visualized by U V illumination, and the 
1 5 nucleic acids in the bands are denatured and electrophoretically transferred to a nylon membrane. After transfer, green 

fluorescent DNA bands are visualized using a hand-held U V lamp, due to the retention of Dye 398. The membrane is 

prehybridized, hybridized and washed according to standard procedures, using a biotin-labeled Ml 3 sequencing primer 
j| (specific for the lacl gene). Hybridized bands are detected using streptavidin alkaline phosphatase along with 

$ NBT/BCIP substrate. All fragments that contain a primer binding site show specific hybridization signals (a 

20 bluish/purple color). In addition, the presence of the dye also does not affect on the efficiency of hybridization, since an 

identical (control) gel that is not stained but is blotted and hybridized at the same time exhibits identical signals. The 

dye signal is lost during hybridization, so the blot is restained to visualize all of the DNA bands. RNA can also be 

detected on filter membranes by staining with an appropriate dye. 

25 Example 26. Cpuntersiaining metaphase chromosomes a nd interphase nuclei 

Human metaphase chromosome spreads are prepared according to standard procedures. Spreads arc denatured, 
prehybridized and hybridized, according to standard procedures, to alpha centromere repeat probes that have been 
labeled with a biotin-labeled nucleotide triphosphate by random priming. The hybridized probes are then detected by 
further labeling with TEXAS RED fluorophore- labeled streptavidin (Molecular Probes, Inc., Eugene OR) and are 
30 counterstained by applying a 1 solution of j 1 11 4 in phosphate-buffered saline (PBS). Samples are mounted, 
covershps sealed and stained chromosomes are visualized with a fluorescence microscope and a fluorescein filter set to 
see the counterstain and a filter set appropriate for the TEXAS RED fluorophore to visualize the centromere signal. 
$ Thls assa y can De generalized to be used with a fluorophore label, either on the nucleoside triphosphate or the 

streptavidin, that is spectrally distinct from the counterstain. 

35 

Example 27. Chromosome banding 

Human metaphase chromosome spreads are prepared according to standard procedures. The coverslip is rinsed with 
PBS, then stained with 0.1 uM Dye 1 1 14 in 0.1 M sodium phosphate, pH 6.5 for 30 minutes at 37 °C and rinsed with 
^ PBS. Chromosomes are then counterstained with 10 mg/mL Methyl Green in the same buffer, for 30 minutes at 37 °C. 
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The slide is rinsed twice in PBS and then mounted in 10% PBS containing 1 mg/mL /?-phenylenediamine and 78% 
glycerol. Chromosomes containing bands are observed through a fluorescence microscope equipped with a standard 
fluorescein filter set. 

j 

5 Example 28. Detection cf protein/DNA complexes i.i geis using pre-labeled DNA templates 

Single-stranded M 1 3 phage DNA is mcubrted, *n an appropriate binding buffer, *vith proteins required for T4 phage 
replication as follows: g4 1 p (helicase), g6 1 p (primase) and g4 1 p in the presence of g6 1 p. Samples are incubated for 
% sufficient lime for complex formation then electrophoresed en an agarose gel using a running buffer that is optimized for 

DN A/protein complex formation. The gel is stained with Dye 377 as described in Example 1 9 above. DNA containing 
10 bands are visualized directly using 254 nm epi -illumination or 300 nm transillununauon. Samples containing primase 
^ alone or pnmase plus helicase result in shifted electrop' relic mobility complexes in comparison with samples 

containing no protein at all. The helicase does not yield a shifted complex by itself. This assay can be generalized to 
detect binding of any nucleic acid binding protein or factor that causes a shift in the electrophoretic mobility of the 
J template upon binding. 

15 

Example 29. Deletion of sequence-specific DNA tinting protein? in sell extracts 

DNA templates of about 25 to about 200 base pairs in length, containing sequences of interest are incubated with Dye 
|j 1 1 14 at a dye:bp ratio of 1 : 30, in the dark, at room temperature. A DNA template that is virtually identical, except for 

3 lacking the test sequence is labeled and treated in parallel. Extracts are prepared from cells of interest using standard 

20 techniques. Approximately 1 ng to 1 microgram of DNA is incubated with about 1 5 micrograms of protein from the 
crude extract, in the presence of about 2 micrograms of poly(dI-dC)-poly(dI-dC) carrier nucleic acid and bovine serum 
albumin in a buffered solution. The sample is incubated for about 1 5 minutes at about 30 °C, in the dark. Generally a 
titration of extract must be tested in order to determine the optimal concentration for detection of specific binding 
interactions. FICOLL or glycerol is added, to a final concentration of about 5-7 .5% and the samples loaded onto a 
25 polyacrylamide gel that is cast using low ionic strength buffers. A sample containing bromophenol blue tracking dye 
and FICOLL or glycerol alone is loaded in parallel. Samples are electrophoresed until the bromopheuol blue has run at 
least a few inches into the gel. The gel apparatus is disassembled and the green fluorescent bands directly observed 
following illumination using 254 nm or 300 nm U V light, or a laser scanner with -490 nm excitation light and -530 nm 
collecuon filters. Extracts containing sequence-specific binding factors that recognize the template of interest will yield 
30 bands of shifted mobility with respect to other extracts and the combinauon of such extracts with thr ~?ntrol DNA 
template. 

Example 30. Preparation and use of prelabeled marker DNA 

The same labeling technique of Example 19 is used to stain unlabeled DNA markers to prepare prelabeled DNA 
3 5 markers. Some bands are visible in the presence of ordinary fluorescent room light alone or visualized as above. The 
posiuon of the bands indicates the distance that the samples have migrated and can be used to determine the size of other 
DNA molecules that are electrophoresed in tandem on the same gel 

Example 3 1 . Detection of ribosomal RNA in sucrose gradients 
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Mammalian cells axe grown under standard conditions. RNA is prepared using standard protocols. A gradient of 
sucrose (10-40% w/v) is prepared in a buffer containing 20 mM Tris-Cl, pH 8.0, 5 mM EDTA, and 1 uM Dye 388 in 
polypropylene centrifuge tubes. In a volume of 0.5 mL or less, the RNA is carefully layered on top of the gradient. 
Gradients are kept protected from light. The tubes are loaded into a Beckman SW28 (or equivalent) rotor and 
centrifuged at 26,000 rpm for 24 hours at 1 5 °C. The tubes are carefully removed from the rotor and the nucleic acids 
visualized as brightly green fluorescent bruids usirg a handheld UV lamp. Ribosomal RNA's are visible as three 
independently migrating species; the most rapid is the 23S, the next is the 16S and the slowest are the 5S species, and 
tRNA's. Nucleic acids are collected by piercing the bcttom of the gaadient, using a 2 1 gauge needle. Small (0.5 mL) 
fractions are collected and aliquots of each analyzed by gel electrophoresis in comparison with RNA's of known size. 



Example 32. Counterstaimng fixed tissue culture eel 1 * *hat have been probed an additional detection reagent 
Mouse fibroblast cells (NIK 3T3) are grown under standard conditions Cell media is removed and the cells washed 
briefly with HBSS (Hanks balanced salt solution with magnesium and calcium). Cells are fixed with 3.7% 
formaldehyde in HBSS and washed three tunes more with PBS. Cells are permeabilized with 0. 1 % TRITON X- 1 00 in 
1 5 PBS, with agitation for 5 minutes Cells are nnsed three times with PBS, blocked by incubation with 2% fetal calf 
serum, 0.1% Tween 20 in PBS for 30 minutes to an hour. A rabbit antibody directed against Golgi membranes is 
applied in blocking solution, for one hour. Cells are nnsed in PBS and then incubated with an anti-rabbit secondary 
antibody that has been conjugated to TEXAS RED dye (diluted in blocking buffer), then washed again in PBS. To 
i§ counterstain, a solution containing 0.4-0 0 1 uM Dye 11 1 4 is applied to the cells and they are incubated for 10 minutes 

20 at room temperature. Cells are washed briefly in PBS and visualized with a fluorescence microscope and standard 

fluorescein filters to visualize counterstaimng and through a filter set for TEXAS RED dye to visualize Golgi staining. 
Nuclei show bright green fluorescence and the cytoplasm appears slightly dimmer green. 

Example 33. Detection and quantitation of DNA amplification products 

25 Target-specific primers contain hapten or fluorophore labels on their 5' ends that are biotin, dinitrophenyl, a fluorescein 
fluorophore, a BOPIPY FL fluorophore, a BODEPY TMR fluorophore, or a BODIPY TR fluorophore (Molecular 
Probes, Eugene OR). Target DNA -containing samples are combined with primer pairs in the presence of appropriate 
buffers and samples are amplified according to optimal conditions for each primer pair. Such conditions must be 
determined empirically. DNA amplification products are then detected by either loading aliquots of samples onto 

30 agarose or polyacrvlamide gels followed by staining as in Example 1 9, or by a solution assay as in Example 2 1 . The 
^ amount of the DNA amplification product present at the end of the amplification reaction is a direct indicator of the 

amount of target present in the original sample, thus it can be used to assay target number, even when such numbers are 
^ too low to assay by direct application of the technique described in Example 2 1 . The enhanced sensitivity of the present 

dyes also allows analysis of amplification products after fewer amplification cycles. This procedure is illustrated 

35 schematically in Figure 2. 

Example 34. Detection of single-strand conformation polymorphisms 

DNA amplification products with sizes ranging from 100-250 base pairs, containing sections of human p53 and K-ras 
$! genes are prepared from human gastric adenocarcinomas as described by Perkins, et al. (NUCLEIC ACIDS 
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' RESEARCH, 21, 3637 (1993)). About 20-100 ng of the DNA amplification products, in a volume of 5 uL, is mixed 

with 0.4 of 1 M methylmercury hydroxide, 1 uL of 1 5% FICOLL and 13.6 uLof TBE buffer. The mixture is heated 
i to 85 °C for 4 minutes and then quickly chilled on ice. A 20% polyacrylarnide gel prepared using TBE buffer, pre- 

' i equilibrated at a set temperature (which must be determined empirically for each sample) and the samples loaded onto 

5 the gel along with a sample containing only FICOLL and tracking dye. The gel is electrophoresed under constant 
% tempeiature control until the marker dye is close to the bottom of the gel. The gel ;s stained with a 1 solution of Dye 

377 in TBE as described in Example 1 9 and visualized using 254 iim-300 nin U V illumination. DNA molecules that 
ft differ in sequence appear as bands with distinct separate mobilities. The presence of bands with different mobilities is 

^ therefore indicative of even single point mutations in the target genes. 

10 

( ^ Example 35 Determination of superhelical state by gel electrophorcsi? 

Closed circular DNA is prepared using standard procedures. Samples of closed circular DNA and size marker DNA 
samples are applied to a series of 0.7% agarose mmigels containing dyes in the concentration range of 0.01 uM to about 
1 jiM. Samples are electrophoresed until the circular forms have migrated at least half of the length of the gels. Gels 
1 5 are then visualized directly using ultraviolet illumination or are poststained with Dye 377 and then visualized, as 

described in Example 19. Closed circular samples generally contain both supercoiled and relaxed DNA molecules. 
Treatment with enzymes such as topoisomerases or gyrases can change the topological characteristics of closed circular 

|j DNA, such as the number of supercoils present in a given molecule. If intercalating dyes such as ethidium bromide are 

^ bound to templates with negative supercoils versus relaxed DNA molecules, more dye molecules bind to the negatively 

20 supercoiled template than to the relaxed molecule. In addition, as negatively supercoiled DNA is titrated with ethidium 
bromide, the molecule passes from a negatively supercoiled form to relaxed DNA and then finally becomes positively 
supercoiled. These three different topological forms are characterized by their migration in electrophoretic gels. In 
general, supercoiled DNAs migrate more rapidly than identically sized relaxed molecules or linear DNA's. There is a 
critical concentration of ethidium bromide that induces the change from negatively supercoiled to relaxed to positively 
25 supercoiled DNA. This concentration for ethidium bromide occurs at about 0. 1 to 0.5 ug/mL dye. 1 he dyes of the 

present invention, such as Dye 377 can also cause this change in topological form. Since these dyes allow detection of 
much less DNA in a band on a gel, they provide a much more sensitive assay than do dyes such as ethidium bromide for 
this application. In addition, the new dyes can be used in combination with ethidium bromide, as sensitive poststains. 
Thus Dye 377 can be used to probe the topological state of closed circular DNA molecules and can therefore be used to 

^ 30 assay topoisomerase or gyrase activity on such templates. 

Example 36. Labels for m icroinjection of DNAs 
| Plasmid DNA is labeled with Dye 1 1 1 4 by incubauon for at least five minutes at room temperature, protected from 

light, with a solution containing no more than 1 dye molecule per 5 base pairs of DNA. DNA is microinjected into cells 
35 using standard techniques (Noueiry et al , CELL, 76, 925 (1994)). Labeled DNA appears as bright green fluorescence 
in cells, using a fluorescence microscope fitted with a fluorescein filter set. 



«3 



Example 37. Labeling and detection o f single DNA molecules 
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Individual phage lambda DNA molecules are tethered to microscope slides by either tethenng one end through 
biotin/streptavidin linkages or polylysine spread binding (Perkins et al. SCIENCE 264, 822 (1994); Perkins et al., 
SCIENCE, 264, 819 (1994)). A solution containing 10 nM Dye 1 1 14 in TE, with 2% p-mercaptoethanol is applied lo 
the slide. Coverslips are mounted in the presence of the dye staining solution and a mounting medium. Single stained 
DNA molecules can be observed in the fluorescence microscope with a standard fluorescein optical filter set. Molecules 
cm be spread or stretched using optical tweezers (Perkins et al. and Perkins ct al. supra, Bensiinon ct al., SCIENCE 
265, 2096 ( 1 994)). SLigle nucleic acid molecules can also be detected and sized in a flow cytoraeter following staining 
with this dye, in a manner analogous to that used for staining with TOTO- 1 nucleic acid stain (Goodwin et al., 
NUCLEIC ACIDS RESEARCH 21, 803 (1993); Castro et al., ANAL. CHEM. 65, 849 (1949)). 

Example 38. Quantitation of cell number 

Tissue culture cells are grown under standard conditions. Cells are harvested by centrifugauon for nonadherent cells 
and by trypsinization followed by centnfugauon and washing in PBS for adherent cells. Cell pellets are lysed by 
suspension in 100 nL of a solution of 0. 1 % TRITON X- 1 00 detergent in water. Cell lysates arc diluted to 1 mL with 
TBE and then added directly to 1 mL of a 0.8 uM solution of Dye 4 10 in TBE and mixed. Samples are incubated about 
5 minutes in the dark and then fluorescence at 520 nm is measured following excitation at 485 nm using a standard 
fluoromeler. The intensity of the fluorescence emission is directly proportional to the amount of double-stranded DNA 
present, which is directly proportional to the cell number, as shown in Table 10 below. Fluorescence emission is 
compared directly with a standard curve made from known amounts of DNA (as described in Example 2 1 , Figure 3) to 
determine the amount of DNA present and is compared with results from a standard curve prepared with known 
quantities of the identical type of cell in order to directly assay for cell number. While the dynamic range of this assay is 
exceptionally large, as shown in Figure 5A, as few as 5-10 cells/mL can be detected using this procedure, as shown in 
Figure 5B). The dyes can also be used in this way to assay reagents drugs or hormones that either inhibit or enhance 
cell proliferation. 

Table lu Relationship between cell number and DNA content 



Cell Type 


Cells/mL 


DNA 
equivalent/mL 


DNA/cell 


NIH/3T3 cells 


50.000 


off scale 


nd 




5,000 


54 4 ng/mL 


10.9 pg/cell 




500 


5 56 ng/mL 


11. 1 pg/cell 




50 


5 1 6 pg/mL 


10.3 pg/cell 




25 


256 ng/mL 


10.2pfz/cell 


P3X cells 


50.000 


197.5 ng/mL 


4.0 pg/cell 




5,000 


1 6 7 ng/mL 


3.3 pg/cell 




500 


1 47 ng/mL 


2.9 pg/cell 




50 


148pg/mL 


3 0 pg/cell 




25 


61.3 pg/mL 


2.5 pg/cell 
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Example 39. Discrimination of RNA. ds DNA and ss DNA using nucleases in combination with fluorescent <fres 
Samples containing either RNA, double -stranded DNA or single- stranded or combinations of these nucleic acids in 
concentrations of about 100 pg/mL to about I ug/mL are incubated independently with the following reagents: a) 

5 DNase I (which digests double-stranded DNA), b) RNase A and T 1 Nuclease (which digest RNA). c) mung bean 
nuclease (which digests single-? tranded DNA) or d) RNase H (which digests DNA/RNA hybrids and some double- 
stranded RNA's) in the presence of the appropriate buffer for each enzyme. In addition, control samples that are not 
subjected to enzymatic digestion are prepared. After digestion is allowed to go to complet ; on, samples are added to 
cuvettes containing 0.4-0.8 uM of a dye of the present invention, such as Dye 309; samples a/e then mixed and 

10 incubated 5 minutes in the dark. Fluorescence intensity is measured in a fluorometer. The type of nucleic acid present 
in the sample is determined using Table 11. If a sample yields fluorescence (indicated by + in the table) equal to the 
amount yielded by the undigested control, then it does not primarily consist of the nucleic acid targeted by the enzyme. 
This set of data can be used to determine the amount of each species of nucleic acid present in a mixed sample, using 
standard curves generated with pure double-stranded DNA, single-stranded DNA, RNA and RNA/DNA hybrids. 

15 



Table 1 1 : Enzymatic digestion response to selected nucleases 





DNase I 


RNase IATI 
Nuclease 


Mung bean 
nuclease 


RNase H 


double-stranded DNA 




+ 


+ 


+ 


single-stranded DNA 




+ 




+ 


RNA 


+ 




+ 


+ 


DNA/RNA hybrids 




T 


+ 





Example 40. Discrimination of DNA from ss DNA usin£ fluorescent dyes. 

Two nucleic acid samples are prepared having concentrations of less than 0.2 uM The first sample is mixed with a 
25 monomethine dye of the present invention to a final concentration of 0.2 uJvt dye ( 1 : 1 ratio) in TE in a fluorescence 

cuvette. The second sample is mixed with the same dye to a final concentration of about 1 mM or higher, in TE buffer in 
a fluorescence cuvette. Both samples are incubated for at least 5 minutes at room temperature in the dark. A 
fluorescence emission spectrum is generated for each sample, following excitauon at about 485 nm, using a standard 
fluorometer. Samples containing only double-stranded DNA yield fluorescence emission spectra with maxima in the 
30 green wavelengths, at about 500-535 nm at both dye:base rauos. Samples containing only single-stranded DNA, 

however, yield a fluorescence spectrum with a maximum in the green (at about 500-535 nm) only when the dye:base 
rauo is less than 1 . 1 At dye: base ratios greater than 1 : 1 the emission maxima for single stranded nucleic acids shifts to 
longer wavelengths (typically 550-580 nm) 

35 Some of the dyes, such as Dye 377, have very low intensities for the longer wavelength emission and appear to simply 
lose the green fluorescence. Nucleic acids at a final concentration of 1 .5 nM bases are incubated with Dye 377 at a 
concentration of 0.8 uM. Calf thymus DNA was used as the double-stranded molecule (ds DNA) and Ml 3 phage DNA 
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was used for single-stranded DNA (ss DNA). The maximum emission wavelength for double-stranded DNA is at -520 
nm, but for single-stranded DNA under these conditions the peak emission is at -550 nm (as shown in Figure 6). 



10 



Others, such as Dye 1114, have significant longer wavelength signals that are almost as intense as the green emission , 
and double-stranded and single-stranded nue'eic acids can be discriminated in cells. Ethanol-killed £ coli cells are 
suspended in water at a concentration of ~10 8 cells/mL. Three bacterial suspensions are then incubated ai room 
temperature with Dye 1 1 14 at concentrations of 0. 1 uM, 0.5 uM and 1 .0 uM respectively. Following staining, the 
samples are illuminaied at 480 nm and the fluorescence emission recorded from 490 urn to 700 nm, as shown in Figure 
7. At low staining concentrations (0. 1 uM) the fluorescence response is primarily a strong green fluorescence (-520 
nm). As the staining concentration increases (0.5 uM), the green fluorescence intensity increases somewhat, with an 
accompanying increase m red fluorescence (-630 nm). As dye concentrauon continues to increase (1 .0 \M), the red 
fluorescence intensity matches the now-decreasing green fluorescence. The red fluorescence emission is due to the 
presence of single-stranded nucleic acids present in the stained E. coli. 



1 5 Example 4 1 . Base selectivity of selected dyes 

Synthetic homopolymers of nbo- or deoxyribo- nucleic acids are incubated at concentrations of 20-50 uJvl with Dyes 
937, 1004, 993, 309, 396, 410, respectively, at concentrations of about I in TE, for about 5 minutes, at room 
temperature, in the dark. Fluorescence emission at about 500-530 nm is measured in a fluorometer for each sample 
following excitation at 485 nm. Certain of the dyes show pronounced selectivity in fluorescence according to the nature 

20 of the homopolyrner as shown in Table 1 2. Thus these dyes can be used in combination with other dyes, such as 
Hoechst 33258 (which is AT selective) to determine information about primary nucleic acid structure. 



Table 12: Base selectivity of selected dves 



3! 



25 



30 



35 



POLYMER 


Dve 937 


Dve 1004 


Dve 993 


Dye 309 


Dve 396 


Dve 410 


ds DNA 


0.68 


0.34 


0.50 


0.64 


0.93 


0.90 


poly dAJ 
polydT 


0.68 


0.59 


0.67 


0.59 


0.81 


0.92 


poly dG/ 
polydC 


0.59 


0.27 


0.35 


0.50 


0.86 


0.88 


poly dA 


0.062 


0.003 


0.004 


0.005 


0.20 


0.015 


poly dT 


0.054 


0.015 


0.064 


0.13 


0 19 


0.28 


poly dC 


0.021 


0.014 


0.015 


0.02 


0.056 


0.045 


poly dl 


0 07 


0.029 


0036 


0.52 


0.13 


0.32 


poly ribo G 


0.34 


0.36 


0.28 


0.36 


0.81 


0.90 


poly ribo C 


0.002 


0.006 


0.009 


0.007 


0.027 


0.012 


poly ribo U 


0.012 


0.009 


0.042 


0.071 


0.19 


0.097 


poly ribo A 


0.027 


0.018 


0034 


0.057 


0 12 


0.23 
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Quantum yields are shown for several dyes bound to several different nucleic acid substrates. Poly ribo G probably 
shows extremely high quantum yields because it has formed higher order structures such as triple-stranded molecules, 
rather than as a result of base selectivity. Poly dl is a polymer of inosine, which behaves much like guanine in nucleic 
acids. 

5 

Example 42. Detection o f v iable bacteria in a food simple 

One gram samples of ground beef are agitated with 9 mL of sterile water at medium speed in a vonexer for 1 minute 
Three 0. 1 mL aliquots are removed end spread uniformly over the surface of three 100 mm eosm-methylene blue plates, 
which are subsequently incubated for 24-48 hours at 37 °C. An 800 uL aliquot is removed and 200 uL of 5% bovine 

10 serum albumin in sterile distilled water are added. 1 ul of a 5 mM DMSO solution of Dye 345 and 100 uL of a 1 

mg/mL solution of rabbit anti-0 1 57:H7 IgG are added to sample, which is then incubated for 15 minutes at room 
temperature with slow mixing The sample is then washed by centrifugation at 10,000 x g for 20 sec in a 1 .5 mL rube, 
and resuspended in 1 mL of sterile water with 4% glutaraldehyde. After 1 5 minutes incubation at room temperature, the 
bacteria are pelleted by centrifugation as above and resuspended in 1 mL of sterile water. 2 uL of a 1 mM DAPI 

1 5 soluuon in DMSO, 1 uL of 5 mM Dye 345, and 20 uL 1 mg/mL TEXAS RED fiuorophore -conjugated goat anti-rabbit 
IgG are subsequently added and the sample is incubated for 1 5 nun at room temperature with slow mixing. Live bacteria 
are blue fluorescent and dead bacteria are green fluorescent. Only enteropathogenic £ coli are red fluorescent. 

Example 43. MIC determination of an a ntibiotic using flow cytometry 

20 A culture of £ coli is grown to mid-log phase in nutrient broth with shaking at 37 °C. The log-phase culture is 

resuspended in 6 tubes of fresh 0. 2 u -filtered tryptone broth, each containing 4 mL of 2 x 1 0 6 cfu/mL. To each tube is 
added 4 mL of fresh 0.2u-filtered tryptone broth containing a 2X concentration of ampicillin (2 ,20, 200, 2000, 20000 
Mg/mL), or tryptone broth alone (control). The suspensions are incubated for 0, 2, 4 and 6 hours and 2 mL of sample is 
removed at each time point. To the 2 mL sample, 2 uL of 5 mM Dye 398 is added and the suspension is incubated for 

25 1 0 minutes. The distributions of the fluorescence intensities are analyzed by flow cytometry with 488 nm excitation and 
channel 1 (green) fluorescence emission detection. Fluorescence intensity is then plotted against the forward scatter of 
the bacteria for each time of incubation with ampicillin to determine the minimum inhibitory concentration (MIC) of 
ampicillin. 

30 Example 44. In suu cessment of neutr ophil bactencidal activity 

The differential permeability of Dye 397 for mammalian cells but not for live bacteria is used to determine the viability 
of phagocytosed bacteria. Adherent cells, including neutrophils and macrophages, are purified from human peripheral 
blood. £ coli are grown to late log-phase in nutnent broth and opsonized with rabbit anti-E. coli IgG, washed into 
sterile water to a density of 1 x 1 0 7 cfu /mL, and stained by addition of 1 uL/mL of a 1 mM DMSO stock soluuon of red 

3 5 bacteria-permeant Dye 3 1 4 The bacteria are stained for 1 5 minutes and then washed extensively to remove all traces of 
extracellular dye. One uL/mL of a 1 mM DMSO solution of Dye 397 is added to the phagocytes and the culture is 
incubated for 1 5 minutes The residual dye is nnsed ofif with medium and fresh medium containing 1 uM Dye 397 is 
added The labeled bacteria are added to the dye-loaded cells and the bactencidal activity of the phagocytes is indicated 
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by an increase in the progression of green fluorescent staining of the intracellular bacteria, as observed in a microscope 
equipped with a fluorescein long-pass filter set. 

Example 45. Determination of metabolic activity of bacteria using flow cytometry 
5 Salmonella typhimurium are grown to mid-log phase m nutrient broth at 37 °C. Bacteria are washed twice in sterile E- 
% pure water and 1 x 1 0 5 /mL S. typhimurium are jioculaud into 50 mL of tryptone medium of different strengths: 1 00%, 

10%, 1%, and 0% (pure water). After 4 hours growth at 37 °C each culture of bacteria is concentrated by centrifugation 
m at 10,000 x g for 10 minutes, and penr.eabilized by subsequent resuspension in 70% isopropanol for 1 hour. To an 

aliquot of the bacteria cultured with 100% nutrient broth is added 20 pig of heat-inactivated RNase A, and the aliquot is 
10 incubated at 37 °C for 60 minutes. All the bacterial samples are then washed twice by centrifugation and stained with 
Dye i 4 at a final concentration of 5 uM for 30 minutes at room temperature 

The bacterial samples are analyzed using a flow cytometer equipped with an argon laser. The fluorescence detector is 
set to collect light around 530 nm. The top signal cluster in Figure 8 A represents logarithmically growing bacteria 
1 5 (cultured in 100% broth). The somewhat lower signal cluster in Figure 8B is obtained from a culture kept at 1% nutrient 
broth for 3 hours. The appearance of the resulting scatter plot, relative to the 100% and 0% standards, gives a measure 
of the metabolic activity of the bacterial samples. 

3 

£t Example 46. Assav of attachment of ba cteria to cell surfaces 

20 Madin-Darby Canine Kidney (MDCK) cells are cultured in 96-well plates to 70% confluence. Growth medium is 
removed from the wells and replaced with 1 00 uL of sterile physiological saline (PS, 10 mM Na HEPES, 1 35 mM 
NaCl, 5 mM KCI, I mM MgCi 2 , 2 mM CaCI 2 , 5 mM glucose, pH 7 4). A culture of 100 mL of Salmonella 
typhimurium bacteria is grown by shaking at 200 rpm in 37 °C nutnent broth to mid log-phase. The bacteria are 
washed by centrifugation and resuspended in PS to a density of 2 x 1 0 7 /mL. Ten mL of the bacterial suspension is 
25 removed and killed by treatment with 70% isopropyl alcohol for I hour. The killed bacteria are then washed twice in PS 
and resuspended to the original volume. A parallel aliquot is washed twice in PS and resuspended in the same volume 
Five mL of each sample are mixed together and 10 uL of 5 mM Dye 1 1 1 4 is added. The mixture is incubated for 10 
minutes at room temperature. Ten uL of Dye 3 1 4 is men added and the mixture is incubated for an additional 20 
minutes The stained bacterial suspension is then washed twice in PS and serially diluted 1:10 four times. In triplicate, 
30 100 uL of each bacten?' 4 ilution 1 or PS alone, is added to wells in the 96-well plate containing MDCK cells. The pl:;c 
is incubated at 37 °C for 20 minutes with agitaUon every 30 sec. All wells are then gently washed three tunes with PS 
and filled with 1 50 uL of PS. The green fluorescence of the wells is quantified in a mula-well fluorescence plate reader 
using excitation at 485 nm and emission at 520 nm; the red fluorescence is determined by excitation at 590 nm and 
emission at 620 nm. The relative proportions of fluorescence are compared with standard wells containing cells with 
3 5 different amounts of bacteria! suspension 



a 



Example 47. Determination of cell mem brane inte grity using flow cytometry 

Bacten al samples are suspended in water at a density of about 6 x 1 0 6 bacteria per mL of water. Mammalian cells are 
suspended in HEPES-buffered saline at a density of about 1 x 1 0 6 per mL The sample is stained with Dye 1 1 1 4, a 
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universally celi-impermeant stain. Bacterial samples are stained with 5 uM Dye 1 1 14, mammalian cells are stained 
with 1-5 uM Dye 1114. After 30 minutes of incubation the sample is analyzed by flow cytometry on an instrument 
using the 488 nm line of the argon laser. Forward (low angle) light scatter is set at an amplification level suitable for the 
biological objects to be analyzed. The fluorescence detector is set to collect light around 530 nm. Generally, bacteria 

5 require logarithmic signal amplificauon, while mammalian cells can be analyzed with linear signal amplification. The 
relative amounts of viable and non-viable cells can be quantified by comparison with the fluorescence and scatter 
characteristics of the control samples. The results of this experiment are shown in Figure 9 for a 1:1 mixture of living 
and dead bacteria. The uppermost cluster of signals corresponds to dead bacteria, *vhile the lowermost cluster 
represents viable bacteria. The inset plot of Figure 9 shows the excellent correspondence between calculated and 

1 0 measured live/dead ratios. Similar results can be obtained for mammalian cells. 



Example 48: Determination of the Cell Cvcle Distrib ution of Eukarvotic Cells 

A staining buffer is prepared that is 100 mM Tris/HCl set to pH 7.4; 154 mM NaCl, 1 mM CaCl 2 , 0.5 mM MgCl 2 , and 
0. 1% Nonidet P-40. The buffer is supplemented with 500 nM of Dye 1 1 1 4 from a stock solution of 500 uM in dry 

1 5 DMSO. Human lymphocytes are centrifuged to obtain a cell pellet, and resuspended gently in phosphate buffered saline 
(PBS) to obtain a single cell suspension. This cell suspension is slowly injected into 4 volumes of absolute ethanol 
cooled using an ice -water bath, while the suspension is vortexed at maximal speed. The sample thus fixed in 80% 
ethanol (final concentration) is left for at least 1 hour in a freezer at -20 °C. The sample is centrifuged to obtain a pellet, 
and the pellet is resuspended into at least 5 mL of PBS, and incubated for at least 1 5 minutes at room temperature. The 

20 sample is pelleted, and resuspended in PBS. and then 5 ug of RNase A is added per mL of cell suspension. The sample 
is incubated for at least 30 minutes at 37 °C. The sample is pelleted and resuspended in the staining buffer, such that 
the suspension contains 1 x 1 0 3 to 5x 1 0 5 cells per mL After at least 1 5 minutes of staining at room temperature the 
sample is analysed on a flow cytometer equipped with an argon laser set at 1 00 mW output for the 488 nm line. The 
forward (low angle) light scatter signal amplificauon is set such mat signals appear in the upper half of the signal 

25 detection range. The acquisition trigger logic of the instrument on the fluorescence detector is set such that it is 

collecting light around 530 nm (the "fluorescein detector"). The signal amplification rate of said detector is set such that 
signals from the sample under investigation emerge within the detection range. The distribution of signals from the 530 
nm fluorescence detector is analyzed with a cell cycle distribuuon algorithm. As shown in Figure 10A, flow cytometric 
analysis typically shows the horizontal clouds of signals corresponding to cells in the Gl, S and G2 compartments of the 

30 cell cycle. From thus d^a is derived a histogram wb ; -h shows the distribuuon of cells among the G 1 , S and G2 
compartments of the cell cycle (Figure 10B). 

Alternatively, cell cycle distributions may be analyzed using a microscopic imaging system. In this case, cells grown on 
coverslips are nnsed twice with PBS at 37 °C, fixed in 3.7% formaldehyde in PBS at 37 °C for 10 minutes rinsed 3 or 4 
35 times with PBS at room temperature, and permeabilized in acetone at -20 °C for 10 minutes. The fixed cells are then 

rehydrated in PBS at room temperature for 10 minutes and stained with 500 nM of Dye 1 1 14 in 2x saline-sodium citrate 
buffer for at least 1 5 minutes at room temperature. The coverslips are viewed and analyzed with an image analysis 
system dedicated to acquire signals in the fluorescein region of the visible light spectrum, and the distribution of signals 
is analyzed as above 
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Example 49: Analysis of cell proliferation bv continuous bromodeovvii ndine labeling and variable fluorescent labeling. 
A 1 0 mM stock solution of 5-bromodeoxyundine (BrUrd) in PBS is prepared, and filter sterilized. A culture of human 
melanoma cells in DMEM-F1 2 culture medium supplemented with 10% fetal bovine serum and 100 uM BrUrd is 
grown in the dark at 37 °C for 50 hours. The resulting cells are harvested by trypsinizauon, centrifuged, washed once 
with PBS, and the pellet is resuspended in a buffered soluuon. The resulting suspension is supplemented with 1 .2 ug of 
Hoechst 33342 dye such that the suspension contains 1x10 s to 5xl0 5 cells per mL. The sample is stained at room 
temperature in the dark for at least 1 5 minutes. To the stained sample is added Dye 1 1 14 in an amount to pnxiuce a 
final concentrauon of 50 nM, and the sample is stained an additional 1 5 minutes at room temperature in the dark. The 
sample is analysed on a flow cytometer equipped with two argon lasers; the first is set at 100 mW output for the 488 nm 
line, and the second at 40 mW output for the U V line. The forward (low angle) light scatter signal amplification is set 
such that signals from the 488 nm laser line appear in the upper half of the signal defection range. The acquisition 
trigger logic of the instrument on the fluorescence detector is set to collect light around 530 nm. The signal 
amplification rate of the detector that is collecting light between 400 and 480 nm emerging from the UV laser beam (the 
"Hoechst channel"), and the detector that is collecting light around 530 nm from the 488 nm excitation (the "1114 
channel") are set such that all signals from the sample under investigation emerge within the detection ranges of both 
detectors. The distribution of signals from the fluorescence detectors is analyzed using an appropriate software package. 

The typical results of the analysis are shown in Figure 1 1 . Figure 1 1 A shows a bivariate cytogram displaying signal 
distributions in the Hoechst channel (abscissa) and 11 1 4 channel (ordinate). The rightmost cluster in the cytogram, 
labeled G0/G 1 , represents cells which have not entered cell cycling during the observation period. The signal trail 
moving left-upward from this cluster represents cells in the S phase of the first cell cycle. At the end of this trail appear 
cells which arrived in the G2 phase of the first cell cycle. Cells which have undergone mitotic division appear to the left 
and downward from the G2 cluster (labeled as G V). Figure 1 1 B shows the distribution of cells among the cell cycle 
compartments alongside the Hoechst axis. 



It is to be understood that, while the foregoing invention has been described in detail by way of illustration and 
example, numerous modifications, substitutions, and alterations are possible without departing from the spirit and scope 
of the invenuon as described in the following claims. 
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What is claimed is 

1 . A compound of the formula 




wherein 

each R ! is independently H; or an alkyl group having from 1 -6 carbons; an alkoxy group having from 1 -6 carbons; or a 
trifluoromethyl; or a halogen; and t = 1-4; 

10 

R 2 is an alkyl group having i -6 carbons; 

X is O, S, Se or NR 15 , where R 15 is an alkyl group having 1-6 carbons; or X is CR 16 R n where R 16 and R 17 , which may 
be the same or different, are independently alkyl groups having 1-6 carbons, or R 16 and R 17 taken in combination 
1 5 complete a five or six membered saturated ring; 

n = 0, I or 2; 

7* is a biologically compatible counterion; 

20 

Q has the formula Q 1 or Q2 




(Ql) (Q2) 

25 wherein 

Yis -CR 3 =CR 4 -. 
*£} p and m - 0 or I , such that p *- m = 1 , 

59 



BNSDOCID: <WO 9613552A2J_> 



WO 96/13552 PCT/US95/ 13706 

R 5 is a TAIL; 

R 3 , R 4 , R 6 and R 7 , which may be the same or different, are independently H; or an alkyl, aikenyl, polyalkenyl, alkynyl or 
polyalkynyl group having 1 -6 carbons; or a halogen; or a substituted or unsubstituted aryl or heteroaryl; or a substituted 
5 or unsubsututed cycloalkyl having 3-10 carboy, ^ -OR 8 , -SR 8 , -(NR 8 R 9 ); or -OS0 2 R 19 ; or a TAIL; where R 8 and R 9 , 
which can be the same or different, ere independertly H; or alkyl groups having 1-6 carbons; or 1-2 alicyclic or aromatic 
rings; or R 8 and R 9 taken m combination are -(CH 2 )r or -(CH 2 ) 5 - to give a 5 or 6 membered ring; and where R 19 is 
alkyl having 1 -6 carbons, or perfluoroalkyl having 1 -6 ~arbons, or aiyl; 

10 or R 6 and R 7 , taken in combination are -(CH 2 ) V - where v = 3 or 4, or R 6 and R 7 form a fused aromatic ring according to 
formula Q2. 

R 11 , R 12 , R 13 , and R 14 , which may be the same or different, are independently H; or an alkyl, aikenyl, polyalkenyl, 
alkynyl or polyalkynyl group having 1-6 carbons; or a halogen; or a TAIL; or -OH, -OR 8 , -SR 8 , or -(NR 8 R 9 ); 



15 



TAIL is a heteroatom -containing moiety having the formula LINK-SPACER-CAP, 



wherein 



20 LINK is a single covalent bond, -O-, -S-, or -NR 20 -; where R 20 is H, a linear or branched alkyl having 1 -8 carbons, or 
R 20 is -SPACER'-CAP'; 



SPACER and SPACER', which may be the same or different are linear or branched, cyclic or heterocyclic, saturated or 
unsaturated covalent linkages, each having 1-16 nonhydrogen atoms selected from the group consisting of C. N, P, 0 
25 and S, such that the linkage contains any combination of ether, thioether, amine, ester, amide bonds; or single, double, 

triple or aromauc carbon-carbon bonds; or phosphorus -oxygen, phosphorus-sulfur bonds, nitrogen-nitrogen or nitrogen - 
oxygen bonds; or aromauc or heieroaromatic bonds, 



30 



CAP and CAP', which may be the same or different, are -O-R 21 , -S-R 21 , -NR 21 R 22 , or -NT^'R^R 23 



wherein 



R 2 \R 22 , and R are independently H, or a linear or branched alkyl or cycloalkyl having 1 -8 carbons, opuonally further 
subsututed by hydroxy, alkoxy having 1-8 carbons, carboxyalkyl having 1-8 carbons, or phenyl, where phenyl is 
35 opuonally further substituted by halogen, hydroxy, alkoxy having 1 -8 carbons, aminoalkyl having 1 -8 carbons, or 

carboxyalkyl having 1 -8 carbons; or, one or more of R 21 , R 22 and R 23 , taken in combination with SPACER or SPACER' 
or R 20 forms a 5- or 6- membered aromatic, heteroaromauc, alicyclic or heteroalicyclic ring, the heteroatoms selected 
from O, N or S; where W is a biologically compatible counterion; 
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or 

CAP and CAP* independently incorporate a 4-10 membered nng containing at least one nitrogen atom; 
such that at least one of R 3 , R 4 , R 6 , R 7 , R u , R 12 , R 13 , and R u is not hydrogen. 
2. A compound of the formula 



M' R 2 

+ I 
N 




(Rl) r~r uL / > — < CH=CH >— CHQ 



wherein 

each R l is independently H; or an alky] group having from 1 -6 carbons; an alkoxy group having from 1 -6 carbons; or a 
trifluoromethyl; or a halogen; and t = 1-4; 

R 2 is an alkyl group having 1 -6 carbons; 

X is O, S, Se or NR 1 5 , where R 15 is an alkyl group having 1 -6 carbons; or X is CR I6 R 17 where R 16 and R 17 , which may 
be the same or different, are independently alkyl groups having 1 -6 carbons, or R 16 and R 1 7 taken in combination 
complete a five or six membered saturated ring; 

n*=0, 1 or 2; 

Y" is a biologically compatible counterion; 
Q has the formula Q 1 or Q2 

R 5 

/ 

Y N 



=< 



p v 





(Ql) (Q2) 

wherein 
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Y is -CR 3 =CR 4 -, 

p and m = 0 or 1 , such that p + m = 1 ; 
*l 5 R 5 is an alkyl, alkenyl, polyalkenyl, alkynyl or polyalkynyl group having 1 -6 carbons, or R 5 is a TAIL; 

'lK, 

R 4 is an alkyl, alkenyl polyalkenyl, alkyny' or polyalkynyl group having 1 -6 carbons; or a halogen; or a substituted or 
■U unsubstituted aryl or heteroaryl; or a subsututed or unsubstituted cyc'oalkyl having 3-10 carbons; or -OR 8 , -SR 8 , - 

-$ (NR 8 R 9 ); or -OS0 2 R 19 ; or a TAIL; where R 8 and R 9 , which can be the same or different, are independently H; or alkyl 

10 groups having 1 -6 carbons; or 1 -2 alicychc or aromauc rings; or R 8 md R 9 taken in combination are -(CH 2 ) 4 - or - 

(CH 2 ) 5 - lo give a 5 or 6 membered ring; and where R 19 is alkyl having 1 -6 carbons, or perfluoroalkyl having 1 -6 

'A 

carbons, or aryl; having 1 -6 carbons, or aryl; 



R 3 , R 6 and R 7 , which may be the same or different, are independently H; or an alkyl, alkenyl, polyalkenyl, alkynyl or 
1 5 polyalkynyl group having 1 -6 carbons; or a halogen; or a substituted or unsubstituted aryl or heteroaryl; or a substituted 
or unsubstituted cycloalkyl having 3- 10 carbons; or -OR 8 , -SR 8 , -(NR 8 R 9 ); or -OS0 2 R 19 ; or a TAIL; 

R 1 1 , R 12 , R 13 , and R 14 , which may be the same or different, are independently H; or an alkyl, alkenyl, polyalkenyl, 
alkynyl or polyalkynyl group having 1 -6 carbons; or a halogen; or a subsututed or unsubstituted aryl or heteroaryl; or a 
20 subsututed or unsubstituted cycloalkyl having 3-8 carbons; or a TAIL; or -OR 8 , -SR 8 , or -(NR 8 R 9 ); 



TAIL is a heteroatom-containing moiety having the formula LINK- SPACER -CAP, 



wherein 

25 

LrNK is a single covalent bond, -0-, -S-, or -NR 20 -; where R 20 is H, a linear or branched alkyl having 1 -8 carbons, or 
R 20 is -SPACER -CAP', 



SPACER and SPACER', which may be the same or different are linear or branched, cyclic or heterocyclic, saturated or 
30 unsaturated covalent linkages, each having 1-16 nonhydrogen atoms selected from the group consisting of C, N, O and 
S, such that the linkage begins and ends with a carbon atom, and contains any combination of ether, thioether, amine, 
ester, amide, or aliphauc. olefuiic or aromauc carbon-carbon bonds, or aromauc carbon-nitrogen or nitrogen-nitrogen 
bonds, wherein all heteroatoms in the linear backbone of SPACER are separated by at least two carbon atoms, 

35 CAP and CAP', which may be the same or different, are -O-R 21 , -S-R 21 , -NR 21 R 2: , or -NTR 21 R 22 R 23 Y\ 



wherein 



R 21 , R 22 , and R 23 are independently H. or a linear or branched alkyl or cycloalkyl having 1 -8 carbons, optionally further 
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substituted by halogen, hydroxy, alkoxy having 1 -8 carbons, carboxyalkyl having 1 -8 carbons, or phenyl, where phenyl 
is optionally further substituted by halogen, hydroxy, alkoxy having 1 -8 carbons, arrunoalkyl having 1-8 carbons, or 
carboxyalkyl having 1 -8 carbons; or, one or more of R 21 , R 22 and R 23 , laken in combination with SPACER or SPACER' 
or R 20 forms a 5- or 6-membered aromatic, heteroaromatic, aiicyclic or heteroalicyclic ring, the heteroatoms selected 
5 from 0, N or S; where *F" is a biologically compatible countenon, 

or 

CAP and CAP' independently incorporate a 4-10 membered ring containing at least one nitrogen atom. 

0 

3. A compound of the formula 




1 5 wherein 

each R 1 is independently H; or an alkyl group having from 1 -6 carbons; an alkoxy group having from 1 -6 carbons; or a 
trifluoromethyl. or a halogen; and t = 1-4; 

20 R 2 is an alkyl group having 1 -6 carbons, 

X is O, S, Se or NR 15 , where R 1 5 is an alkyl group having 1-6 carbons; or X is CR* 6 R 17 where R 16 and R 17 . which may 
be the same or different, are independently alkyl groups having ! -6 carbons, or R 16 and R 17 taken in combination 
complete a five or six membered saturated nng; 

25 

n = 0, 1 or 2; 

7* is a biologically compatible countenon. 
30 Q has the formula Q 1 or Q2 
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Y N 

m \ e 

R 




(Ql) 



wherein 



5 Y is -CR 3 =CR 4 - 



p and m = 0 or 1 , such that p + m = 1 , 



Y-n' R 11 

(Q2) 



10 



R 5 is a cyclic subsutuent that is a substituted or unsubstituted aryl or heteroaryl; or a substituted or unsubstituted 
cycloalkyl having 3-10 carbons; 



15 



R 3 , R 4 . R 6 and R 7 . which may be the same or different, are independently H; or an alkyl, alkenvl, polvalkenyl alkynyl or 
polyalkynyl group having 1 -6 carbons; or a halogen; or a substituted or unsubstituted aryl or heteroaryl; or a substituted 
or unsubstituted cycloalkyl having 3-10 carbons; or -OR 8 , -SR 8 , -(NR 8 R 9 ); or -OS0 2 R 19 ; or a TAIL; where R 8 and R 9 , 
which can be the same or different, are independently H; or alkyl groups having 1 -6 carbons; or 1 -2 alicyclic or aromatic 
rings; or R 8 and R 9 taken in combination are -(CH 2 ) 4 - or -(CH 2 ) 5 - to give a 5 or 6 membered ring; and where R 19 is 
alkyl having I -6 carbons, or perfluoroalkyl having 1 -6 carbons, or aryl; 



20 



or R 6 and R 7 , taken in combination are -(CH 2 ) V - where v = 3 or 4, or R 6 and R 7 form a fused aromatic ring according to 
formula Q2; 



R l 1 , R 12 , R 13 , and R u , which may be the same or different, are independently H; or an alkyl, alkenyi, polyalkenyl, 
alkynyl or polyalkynyl group having 1 -6 carbons; or a halogen, or a TAIL; or -OH. -OR 8 , -SR 8 , or -(NR 8 R 9 ); 



25 



TAIL is a heteroatom-containing moiety having *he formula LINK-SPACER-CAP; 



wherein 



L[NK is a single covalent bond, -0-, -S-, or -NR -; where R 20 is H, a linear or branched alkyl having I -8 carbons, or 
30 R 20 is -SPACER-CAP'; 



3 



SPACER and SPACER', which may be the same or different are linear or branched, cyclic or heterocyclic, saturated or 
unsaturated covalent linkages, each having 1-16 nonhydrogen atoms selected from the group consisting of C, N, P, O 
and S, such that the linkage contains any combination of ether, thioether, amine, ester, amide bonds; or single, double, 
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triple or aromatic carbon-carbon bonds; or phosphorus-oxygen, phosphorus-sulfur bonds, nitrogen-nitrogen or nitrogen- 
oxygen bonds; or aromatic or heteroaromatic bonds, 



CAP and CAP', which mav be the same or different, are -N*R 21 R 22 R 23 T* 

* 5 

^ wherein 



j§ R 21 , R 22 , and R 23 are independently a lmear or branched alk>l or cycloalkyl having 1 -8 carbons, optionally further 

substituted by hydroxy, alkoxy having 1 -8 carbons, carboxyalkyl having 1 -8 carbons, or phenyl, where phenyl is 
10 opuonaliy further substituted by halogen, hydroxy, alkoxy having 1 -8 carbons, aminoalkyl having 1 -8 carbons, or 

1$ carboxyaftyl having 1-8 carbons; or, one or more of" 21 , R 22 and R 23 , taken in combination with SPACER or SPACER' 

or R 20 forms a 5- or 6-membered aromatic, heteroaromatic, alicyclic or heteroalicyclic ring, the heteroatoms selected 

X from O, N or S. where T* is a biologically compatible countenon; 

15 or 



CAP and CAP' independently incorporate a 4-10 membered ring containing at least one nitrogen atom; 

i 

# such that at least one of R 3 , R 4 , R 6 , R 7 , R u , R 12 , R 13 , and R 14 is a TAIL, and where more than one of R 3 . R 4 , R 6 , R 7 , 

t 20 R 11 , R 12 , R 13 , and R 14 is a TAIL, each TAIL is optionally the same or different. 



4. A compound, of the formula 




30 X is O or S: 



n ' 0 or 1 , 
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R 3 isH. 

R 1 \ R 12 , R 1 3 , and R 14 , which may be the same or different, arc independently H; or an alkyl having 1 -6 carbons; or a 
halogen; or -OH, -OR 8 , -SR 8 , or -(NR 8 R 9 ); where R 8 and R 9 , which can be the same or different, are independently H; 
or alkyl groups ha<ang 1 -6 carbons; or 1 - 2 alicyclic or aromatic rjigs; or R 8 and R 9 taken in combination are -(CH 2 ) 4 - 
or -(CM 2 ) 5 - to give a 5 or 6 membered ring; and where R 19 is aikyi having 1 -6 carbons, or perfluoroalkyl having 1 -6 
carbons, or aryl; and 

R 3 i? a cyclic substituent that is a substituted or wu /otituted aryl; and R 4 is a TA T L that is heteroatom-containing 
moiety having the formula LINK-SPACER-CAP, 

wherein LINK is a single covalent bond, -0-, -S-, or -NR 20 -; where R 20 is H, a linear or branched alkyl having 
1 -8 carbons, or R 20 is -SPACER'-CAP'; 

SPACER and SPACER* independently have the formula -(CH 2 \-, where k = 1 -8; 

CAP and CAP', which may be the same or different, are -NTR 2i R 22 R 23 T"; where R 21 , R 2 \ and R 23 are 
independently methyl or ethyl; 

or R 5 is an alkyl having 1 -6 carbons; and TAIL is a heteroatom-containing moiety having the formula LINK-SPACER- 
CAP; 

25 wherein LINK is a single covalent bond, -0-, -S-, or -NR 20 -; where R 20 is H, a linear or branched alkyl having 

I -8 carbons, or R 20 is -SPACER'-CAP'; 

SPACER and SPACER' independently have the formula -(CH 2 ) k -. where k = 1-8. 

30 CAP ~i CAP', which may be the same or different, are -NR 2i R 22 or -N^R 21 R 22 R 23 Y'; where R 21 , R 22 , and 

R 23 are independently methyl or ethyl. 

5. A compound, as claimed in Claims 1 , 2 or 3, wherein X is O or S; each R l is H; R 2 is methyl or ethyl; n is 0 or 1 ; and 
R 6 and R 7 form a fused aromatic nng. 

6. A compound, as claimed in Claim 5, wherein p is 0 and m is I 

7 A compound, as claimed in Claims 1 , 2 or 3 wherein each R 1 is H. and R 2 is methyl or ethyl 
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8. A compound, as claimed in Claim 7, wherein X is O or S. 

9. A compound, as claimed in Claims 1 , 2 or 3, wherein p = 0, m = 1 ; and n = 0 or 1 . 

5 10. A compound, as claimed in Claims 1 , 2 or 3, wherein R 4 is a halogen, -OR 8 , -SR 8 , -(NR 8 R 9 ). or -OS0 2 R 19 
1 1 . A compound, as claimed in Claims 1 , 2 or 3, wherein R 4 is an alkyl having 1 -6 carbons. 



*5 



10 



15 



1 2. A compound, as claimed in Claims 1 , 2 or 3, wherein R 4 is a substituted or unsubsututed aryl or heteroaryl; or a 
substimted or unsubsututed cydoalkyl having 3-10 carbons, 

13. A compound, as claimed in Claims 1 , 2 or 3, wherein R 4 is a TAIL 

14. A compound, as claimed in Claims 1 , 2 or 3, wherein said compound has at least 2 permanent positive charges. 

15. A compound, as claimed in Claims 1 , 2 or 3, wherein CAP and CAP' are independently 



— f/ | — r/ y — — N CZ/° N \ 



N 



,21 



.23 



.23 



.23 



. + \/-\ \r~\ 



.23 



-4/ V „ — \ y * 

\ / \ 22 \ / 



. where R 21 , R 22 , R 23 and Y" are as defined previously. 



20 16. A compound, as claimed in Claims 1 , 2 or 3, wherein R 20 is H or a linear or branched alkyl having 1 -8 carbons. 

1 1. A compound, as claimed in Claim 1 , 2 or 3, wherein SPACER and SPACER* independently have the formula 
-(CH 2 ) k -, where k = 1-8 

25 1 8 A compound, as claimed in Claims 1 , 2 or 3, wherein R 21 , R 22 , and R 23 are independently methyl or ethyl. 

1 9. A compound, as claimed in Claim 2, wherein R 5 is a TAIL. 
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20. A compound, as claimed in Claim 2, wherein R 5 is an alkyl having 1 -6 carbons. 

2 1 . A compound having the formula 



2 

¥ R 




Q^Y_ (CH= CH,-C, 



wherein 

R 2 and R 24 are independently a linear or branched alkyl having 1 -6 carbons; 
X is 0, S, Se or NR 15 , where R 15 is an alkyl group having 1-6 carbons; or X is C(CH 3 ) 2 ; 
n = 0. 1 or 2; and 
15 Y* is a biologically compatible counierion. 
22. A compound having the formula 

^ + 24 
N — R 



20 




wherein R 24 is a linear or branched alkyl having 1 -6 carbons; and Y" is a biologically compatible counierion. 

23. A fluorescent complex comprising a nucleic acid polymer non-covalently bound to one or more molecules of a dye 
compound, which dye compound is as claimed in any one of Claims 1-21. 

24 A fluorescent complex, as claimed in Claim 23 , wherein the nucleic acid polymer is a chromosome. 

25. A fluorescent complex, as claimed in Claim 23, wherein the nucleic acid polymer is a natural or synthetic 
oligonucleotide 

26. A fluorescent complex, as claimed in Claim 23, wherein said complex is enclosed in a biological structure. 
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27. A fluorescent complex, as claimed in Claim 23, wherein said complex is preseni in an eiecirophoretic matrix. 

28. A fluorescent complex, as claimed in Claim 23, wherein said complex is present in a flowing medium. 



5 29. A fluorescent complex, as claimed m Claim 23, wherein the nucleic acid polymer comprises modified nucleic acid 

$ bases or links. 

|j 30. A fluorescent complex, as claimed in Claim 23, for use aj a prelabelec marker. 

10 3 1 . A method of staining nucleic acids, comprising 

a) combining a sample that contains or is thought to contain a nucleic acid, with a mixture comprising one or more dye 
*.* compounds as claimed in any one of Claims 1-21, where the dye compounds are the same or different and the dye 

compounds are present in an amount effective to combine with the nucleic acid in the sample; 



and 



^ b) incubating the sample and the mixture for a time sufficient for the dye compound to combine with the nucleic acid in 

*4 the sample to form one or more dye-nucleic acid complexes that give a detectable fluorescent signal. 

20 

32. A method, according to Claim 3 1 , wherein said sample or said mixture comprises an electrophorelic gel. 

33. A method, according to Claim 3 1 , wherein the dye-nucleic acid complexes are separated by electrophoresis. 
25 34. A method, according to Claim 3 1 , wherein said sample comprises a density or sedimentation gradient. 

35. A method, according to Claim 3 1 , wherein the sample comprises a biological fluid 

36. A method, according to Claim 3 1 , wherein the one or more dye -nucleic acid complexes form in a eukaryote cell, a 
^ 30 prokaryote cell, a virus, or a viroid. 

37. A method, according to Claim 36, wherein the complexes form in a eukaryote cell or prokaryote cell that is in a cell, 
^ tissue, or biological fluid 

35 38. A method, according to Claim 3 1 , where the sample contains cell-free nucleic acids 



39. A method, according to Claim 3 1 , further comprising adding one or more additional reagents to the sample, where 
each additional reagent is capable of a response that is detectably different from the fluorescent signal of the dye-nucleic 
acid complex 
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40. A method, according to Claim 39, where the additional detection reagent is an antibody, a lectin, an enzyme or a 
fluorescent stain. 



4 1 . A method, according to Claim 39, wherein the additional detection reagent is a stain selective for an organelle. 



% 42 - A method, according to Claim 3 1 , wherein th^ dye compound combines with nucleic acids in a biological structure 

to form a pattern of dye-nucleic acid complexes having a detectable fluorescent signal that corresponds to the biological 
'J5 structure, for use in detecting the biological structure 

i 

10 43. A method, according to Claim 42, wherein said biological structure is a cell. 

i 

44 A method, according to Claim 42, wherein the biological structure is a subcellular organelle that is intracellular or 
extracellular. 

15 45. A method, according to Claim 42, wherein the biological structure is a parasitic organism. 

46. A method, according to Claim 42, wherein the biological structure is a blebbmg cell or nucleus. 



$ 47 - A method, according to Claim 42, wherein said sample is a biological fluid or a water sample or a food sample. 

20 

t 

48. A method, according to any one of Claims 42-47, wherein said fluorescent signal is detected with an instrument and 
used as a basis for sorting said biological structures 

49. A method, according to claim 3 1 , wherein the dye compound combines with nucleic acids in the sample to form a 
25 staining profile of dye-nucleic acid complexes having detectable fluorescent signals, said staining pattern having a 

shape, location, spectral property, or intensity that is indicative of a characteristic of the sample, for use in 
characterizing the sample based on said staining profile. 

50 A method, according to Claim 49, wherein the sample is characterized as containing a type of cell based on the 
30 staining profile. 



5 1 . A method, according to Claim 49, wherein the sample coniauis nucleic acids that are natural or synthetic single 
stranded (ss) or double stranded (ds) nucleic acid polymers that are combined with the dye compound in a rauo of at 
least one or more molecules of the dye compound per base of the ss or base pair of the ds nucleic acid polymer to form a 

35 staining profile having a spectral property of fluorescence intensity at an emission wavelength that is indicative of ss or 
ds nucleic acid polymers. 

52. A method, according to Claim 49, wherem the sample is a solution comprising nucleic acids that are nucleic acid 
polymers separated by means of relative mobility; where the solution is characterized with respect to purity of the 
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solution, size of polymers in the solution, 
solution based on the staining profile. 



53. A method, according to Claim 49, wherein the sample is a chromosome and an additional reagent that is added to the 
5 sample quenches or partialU quenches the fluorescent signal from one or more of the dye-nucleic acid complexes, such 
that the chromosome is characterized as having a certain banding based on the staining pattern. 

5<\. A method of deterrnining cell membrane integrity comprising; 

1 0 a) incubating a sample containing one or more cells with a first dye compound as claimed in any one of Claims I -20 
having an overall positive charge of 2+ or greater, whe said dye is present in an amount effective for staining 
intracellular nucleic acids only in cells without intact cell membranes without staining intracellular nucleic acids in cells 
with intact membranes, for a time sufficient for the dye compound to combine with intracellular nucleic acids to form a 
first intracellular dye-nucleic acid complex having a detectable fluorescent signal, and 

15 

c) detennining cell membrane integrity of cells in the sample based on presence of the detectable fluorescent signal, 
where the presence of the detectable fluorescent signal indicates that the cell membrane integrity is compromised and 
the absence of the detectable fluorescent signal indicates that the cell membrane integrity is intact. 

20 55. A method, according to Claim 54, wherein the dye compound has an overall positive charge of 3+ or greater. 

56. A method, according to Claim 54, wherein the sample contains eukaryotic cells. 

57. A method, according to Claim 54, wherein the sample contains prokaryouc cells. 

25 

58. A method of quantitatmg nucleic acids in a sample, comprising 

a) combining an aliquot of a sample, optionally the entire sample, that contains or is thought to contain a nucleic acid, 
with mixture containing a cyanme dye compound as claimed in any one of Claims 1 -20, where the cyarune dye 

30 compound is prese^' \n an amount effective to combine with the nucleic acid in the sample, 

b) incubating the aliquot and mixture for a lime sufficient for the cyanme dye compound to combine with the nucleic 
acid in the sample to form a dye-nucleic acid complex that gives a detectable fluorescent signal; and 

35 c) quantifying the nucleic acid present in said sample based on comparison of intensity of the detectable fluorescent 
signal with a reference value of fluorescence that is characteristic of a given amount of nucleic acid. 

59 A method, according to Claim 58, wherein said nucleic acids are polymerase chain reaction amplification products 
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60. A method of quantitating nucleic acids in a sample of cells that has been grown in a tissue or in a culture medium, 
according to Claim 58, wherein said aliquot is an aliquot prepared by the lysis of all or a portion of said cells. 

6 1 . A method, according to Claim 58, for quanutating nucleic acids in a sample population of cells that has been grown 
^ 5 in a tissue or in a culture medium, wherein comparison of intensity of the detectable fluorescent signal with a reference 
^ vMre of fluorescence is done by a fluorescence quantifying instrument that measures fluorescent or a per cell basis and 

said aliquot contains cells. 

j| 62. A method, according to 6 1 , wherein a distribution of intensities of the detectable fluorescent signal reflects a 

10 distribution of cells among cell cycle compartments 

63. A method, according to Claim 60 or 62, wherein said nucleic acids are present in proliferating cells, further 
^ comprising 

1 5 d) taking one or more additional aliquots from the sample over time. 

e) repeating steps a) through c) for each aliquot, and 

i 

^ 0 comparing the distribution of cells among cell cycle compartments or the amount of nucleic acid in the sample over 

20 time to determine cell proliferation in the sample. 

64. A method, according to Claim 63, further comprising 

adding a bisbenzimidazole dye that is Hoechst 33258 or Hoechsl 33342 in an amount effective to combine with nucleic 
25 acids in proliferating cells to give a quenchable fluorescent signal; 

adding a halogen ated deoxyundine in an amount sufficient to be incorporated into nucleic acids in proliferating cells to 
partially quench said quenchable fluorescent signal resulting from the bisbenzimidazole dye; 

30 wherein the dye -nucleic acid complex formed by the cyanine dye gives a detectable fluorescent signal that overlaps 
spectrally with the quenchable fluorescent signal given by the bisbenzimidazole dye, and the detectable fluorescent 
signal is not quenched by the incorporauon of halogenaled deoxyundine into nucleic acids in proliferating cells. 

65 A method, according to Claim 58, wherein the aliquot of a sample that contains a specified amount of total nucleic 
35 acid is combined with more than one molar equivalent of the dye, where the dye is selective for ds nucleic acids, to form 
a dye -nucleic acid complex that gives a detectable fluorescent signal having fluorescence intensity at an emission 
wavelength that is indicative of ds nucleic acid polymers, quantifying the ds nucleic acid present in said sample based on 
comparison of the detectable fluorescent signal with a reference value of fluorescence that is characteristic of a given 
^2 amount of ds nucleic acid. 
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66. A method of analyzing nucleic acid-analyte interactions, comprising. 

a) forming a fluorescent complex comprising a nucleic acid polymer and one or more dye compounds as claimed in any 
one of Claims 1 -20, where the dye compounds are the same or different, and wherein the fluorescent complex has a set 

5 of characteristic spectral properties; 

b) combining the fluorescent complex with a sample that contains or is though: to contain an analyte that interacts with 
the nucleic acid polymer; 

10 c) detecting a change in the spectral properties of the fluorescent complex; and 

d) determining the presence or activity of the analyte in said sample based on comparison of the change in spectral 
properties of the complex with a fluorescent standard characteristic of analyte activity. 

15 67. A method, according to Claim 66, wherein the sample is a cell with which the fluorescent complex is combined by 
artificial means 

68. A method, according to Claim 66, wherein the sample contains cell -free nucleic acid polymers. 
20 69. A method, according to Claim 66, wherein the analyte is a protein. 
70. A method, according to Claim 66, wherein the analyte is a drug. 
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